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Message  from  the  Director 


Many  teachers  worked  with  us 
during  the  1993-94  school  year, 
assisting  in  exam  development, 
field  testing,  marking,  and  the 
administration  of  the  diploma 
exams.  Superintendents,  high 
school  principals,  and  other 
school  personnel  have  also 
helped  make  the  Diploma 
Examinations  Program 
effective.  I appreciate  their 
commitment,  and  I want  to 
thank  them  for  the  support  and 
assistance  they  have  provided. 

Our  annual  report  combines  the 
January,  June,  and  August 
results  for  diploma  exam 
courses.  The  graphs,  tables, 
and  text  describe  student 
performance  for  the  whole 
school  year.  As  before,  we 
present  data  for  three 
consecutive  years  for  each 
diploma  exam  course.  Some 
other  features  of  the  previous 
report  are  repeated,  including 
the  separate  presentation  of 
school  marks,  exam  marks,  and 
final  marks  for  each  course,  and 
results  by  gender. 

The  number  of  students  writing 
diploma  exams  in  the  1993-94 
school  year  remained  fairly 
constant  compared  with  the 
previous  year.  Although  the 
numbers  were  lower  in  the 
sciences,  many  students  wrote 
pilot  exams  in  these  courses. 
Final  marks  in  the  diploma 
exam  courses  show  that  over 
90%  of  our  students  achieved 


the  acceptable  standard  in  each 
course  except  Mathematics  30 
where  the  percentage  was  only 
slightly  below  90  (88.8%). 
Many  students  also  achieved 
excellence,  including  nearly 
19%  of  the  students  in 
Mathematics  30. 

This  year’s  special  study 
examined  participation  rates 
over  three  years.  The  results, 
which  appear  in  Section  5 of  the 
report,  show  consistent  patterns 
in  participation  over  the  past 
three  years,  except  for  declines 
in  biology  and  chemistry. 

I hope  that  you  will  find  this 
report  useful,  and  I welcome 
your  comments  and  questions. 
Please  feel  free  to  call  or  write 
to  me,  or  contact  any  of  the 
Student  Evaluation  staff.  You 
can  also  send  feedback  by 
completing  the  questionnaire, 
which  is  included  at  the  end  of 
the  report.  We  are  committed 
to  communicating  the 
achievement  results  of  our 
graduating  students  clearly  and 
encourage  you  to  share  the 
results  for  your  students  with 
parents  and  others  in  your 
community. 


Frank  G.  Horvath,  Director 
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Section  1 

Grade  12  Diploma  Examinations  Program 


Diploma  examinations  are 
administered  in  January,  June,  and 
August  of  each  school  year. 

The  Grade  12  Diploma  Examinations 
Program,  established  in  1984,  has  three 
main  purposes: 

• to  certify  the  level  of  individual 
student  achievement  in  selected 
Grade  1 2 courses 

• to  ensure  that  pro\  i nee -wide 
standards  ot  achievement  arc 
maintained 

• to  report  indiv  idual  and  group  results 


The  examination  development  process, 
described  in  Appendix  A,  ensures  that 
this  form  of  assessment  provides  valid 
and  reliable  results.  Eight  Grade  1 2 
courses  have  diploma  examinations,  and 
five  of  these*  are  available  in  French 
translation: 

• English  30 

• English  33 

• Social  Studies  30* 

• Fran^ais  30 

• Mathematics  30* 

• Biology  30* 

• Chemistry  30* 

• Physics  30* 


This  Diploma  Examinations  Program 
Annual  Report  provides  province- 
wide results  for  the  entire  school  year; 
that  is,  for  the  January,  June,  and 
August  examinations  combined. 
Additionally,  the  annual  report 
provides  summaries  of  results  by 
gender,  for  population  subgroups,  and 
for  achievement-over-time  studies. 

Occasional  research  findings  on  issues 
of  topical  interest  related  to  the 
program  are  also  featured.  In  this 
1993-94  report,  participation  rates  in 
diploma  examination  courses  for  the 
three-year  period  1991-92,  1992-93, 
and  1993-94  are  reviewed. 


Certification 

A student’s  final  mark  in  a diploma 
examination  course  is  a fifty-fifty 
“blend”  of  the  examination  mark  and 
the  school-awarded  mark  (except  for 
students  with  mature  status;  see 
Section  4).  For  example,  a diploma 
examination  mark  of  57%  combined 
with  a school-awarded  mark  of  45% 
would  produce  a final  course  mark  of 
51%,  a “pass”  in  the  course.  This 
student  would  earn  high  school 
graduation  credits  for  the  course.  The 
“blending”  of  the  two  marks  to  produce 
a final  course  mark  recognizes  the  fact 
that  the  diploma  examination  assesses 
only  those  learning  outcomes,  listed  in 
the  Program  of  Studies,  that  can  be 
effectively  measured  in  a limited  time 
using  paper  and  pencil  tests.  The  school 
can  best  assess  students’  achievement  in 
the  laboratory,  in  research,  in  oral 
communication,  and  in  cooperative 
learning. 

Standards 

The  Program  of  Studies  for  each 
diploma  examination  course  outlines 
what  students  are  expected  to  know  and 
to  be  able  to  do  in  order  to  pass  the 
course.  Information  bulletins  published 
at  the  beginning  of  the  school  year 


provide  details  about  “how  well” 
students  are  expected  to  do;  i.e.,  the 
bulletins  outline  the  assessment 
standards  for  each  diploma  examination 
course.  Students  who  achieve  the 
acceptable  standard  of  performance 
receive  a final  course  mark  of  50%  or 
higher.  Students  who  achieve  the 
standard  of  excellence  receive  a final 
course  mark  of  80%  or  higher. 

Reporting 

The  results  achieved  by  students  in  the 
Diploma  Examinations  Program  are 
aggregated  at  the  school,  jurisdiction, 
and  provincial  levels  and  are  presented 
in  this  and  the  three  reports  described 
below.  The  purpose  of  the  Diploma 
Examination  Program  is  to  help  school 
administrators,  teachers,  trustees,  and 
Alberta  Education  evaluate  the 
effectiveness  of  educational  programs. 
Guidelines  for  interpreting  and  using 
these  reports  are  given  in  Appendix  B. 

These  reports  should  not  be  used  as 
the  basis  for  evaluating  teacher 
performance  or  for  comparing 
performance  between  schools  or 
jurisdictions. 

Percentage  Distribution  of  Marks  in 
Diploma  Examination  Courses  is  a 
three-page  report  distributed  to 


educators  in  schools,  jurisdictions,  and 
other  educational  institutions 
approximately  three  weeks  after  the 
January  and  June  examinations  are 
written.  The  report  is  also  available  to 
the  public  on  request.  The  reports 
issued  in  1994  are  reproduced  in 
Appendix  C. 

School  and  Jurisdiction  Reports  for 
each  diploma  examination  course  are 
distributed  to  superintendents  and 
principals  soon  after  the  January  and 
June  administrations.  These  reports 
provide  results  at  the  question  and  sub- 
test level  for  each  school  and 
jurisdiction.  This  information  is 
particularly  useful  in  assessing  the 
strengths  and  weaknesses  of  local 
programs.  These  reports  are  available 
to  the  public  through  the  superintendent 
or  principal,  according  to  local  board 
policy. 

Examiners  ’ Reports  for  each  course, 
which  are  distributed  at  the  same  time 
as  the  School  and  Jurisdiction  Reports, 
are  written  primarily  for  teachers. 
Provincial  results  are  provided  in 
relation  to  course  standards  as  reflected 
in  the  examination  blueprint  and 
information  bulletins.  The  January  and 
June  1994  Examiners’  Reports  are 
available  on  request. 
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Section  2 

Summary  of  Results 

L A 


This  section  provides  the  overall 
results  and  describes  certain  broad 
characteristics  of  the  students  who 
wrote  the  diploma  examinations. 

The  following  questions  will  be 
answered: 

• What  percentage  of  students 
achieved  the  acceptable  standard  or 
the  standard  of  excellence  according 
to  criteria  set  by  Alberta  Education? 


• How  many  students  wrote  each 
diploma  examination  and  how  do 
these  numbers  compare  with  the 
previous  two  years? 

• What  was  the  average  number  of 
different  diploma  examinations  written 
by  each  student  in  each  course  during 
the  1993-94  school  year? 


compare  with  distributions  of 
previous  years? 

• For  each  diploma  examination 
course,  what  is  the  correlation 
between  examination  marks  and 
school-awarded  marks? 


• What  was  the  distribution  of  A,  B,  C, 
and  F for  each  diploma  examination 
course  and  how  does  this  distribution 


What  percentage  of  students 
achieved  the  acceptable  standard  or 
the  standard  of  excellence  according 
to  criteria  set  by  Alberta  Education? 

Figure  2-1  shows  the  percentage  of 
students  achieving  the  acceptable 
standard  and  the  standard  of 
excellence  based  on  the  final  course 
mark.  The  “final  course  mark”  is  the 
average  of  the  school-awarded  mark 
and  the  diploma  examination  mark  or 
as  otherwise  provided  by  Alberta 
Education  policy. 

During  the  1993-94  school  year,  final 
course  marks  showed  that  in  all 
courses  except  Mathematics  30  and 
Chemistry  30,  more  than  90%  of 
students  achieved  the  acceptable 
standard.  A high  percentage  of 
students  also  achieved  the  standard  of 
excellence  in  the  sciences. 

In  Alberta,  courses  are  selected  by 
students  according  to  their  own  needs, 
aspirations,  and  expectations.  This 
may  account  for  much  of  the 
differential  achievement  among 
courses.  For  this  reason,  local 
expectations  of  the  percentage  of 
students  who  achieve  the  acceptable 
standard  or  the  standard  of  excellence 
are  best  interpreted  in  the  context  of 
local  policies  and  conditions. 


Figure  2-1 


Percentage  of  Students  Achieving  Standards  (Final  Course  Mark) 
1993-94  School  Year 


Eng  30  Eng  33  Soc  St  30  Fr30  Math  30  Bio  30  Chem  30  Phys  30 


Diploma  Examination  Course 

H Students  achieving  the  acceptable  Students  achieving  the  standard 

standard  (final  course  mark  of  excellence  (final  course  mark 

of  50%  to  1 00%)  of  80%  to  1 00%) 
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How  many  students  wrote  each 
diploma  examination  and  how  do 
these  numbers  compare  with  the 
previous  two  years? 

As  shown  in  Figure  2-2,  the  number  of 
students  writing  English  33,  Social 
Studies  30,  Francois  30,  and 
Mathematics  30  consistently  increased 
during  the  last  three  years.  In  English 
30,  the  number  in  1993-94  remained 


relatively  unchanged  compared  with 
the  number  in  1992-93.  As  expected, 
the  number  of  students  writing 
diploma  examinations  in  each  of  the 
science  courses  decreased  in  1993-94 
compared  with  the  previous  two  years. 
The  decrease  could  largely  be  related 
to  the  large  number  of  students  who 
participated  in  the  pilot  programs  for 
the  revised  and  new  courses  in 
sciences.  See  Section  7 for  details. 


Note:  All  students  who  wrote  more 
than  one  diploma  examination  in  a 
course  during  a single  year  are 
counted  only  once.  Students  who 
wrote  examinations  in  the  same  course 
in  different  years  are  counted  once  in 
each  year  they  wrote.  Students  from 
the  Northwest  Territories  arc  not 
included  in  these  counts.  Because 
Figure  2-2  includes  students  who 
were  not  given  a school  mark,  the 


Figure  2-2 


Number  of  Students  Writing  Diploma  Examinations 
in  Each  Course 

1991-92, 1992-93,  and  1993-94  School  Years 


Thousands  of  Students 


f7]  1991-92  1992-93  ^ 1993-94 
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numbers  are  slightly  higher  than  in  the 
figures  on  pages  5 to  8. 

What  was  the  average  number  of 
different  diploma  examinations 
written  by  each  student  in  each 
course  during  the  1993-94  school 
year? 

As  shown  in  Figure  2-3,  the  average 
number  of  different  diploma 
examinations  written  by  students 
ranged  from  a low  of  1.5  for  students 
writing  the  English  33  examination  to 
a high  of  4.6  for  students  writing  the 
Fran9ais  30  examination. 


What  was  the  distribution  of  A,  B, 
C,  and  F for  each  diploma 


examination  course  and  how  does 
this  distribution  compare  with 
distributions  of  previous  years? 

The  distribution  of  A,  B,  C,  and  F for 
each  course  is  shown  in  figures  2-4  to 
2-19. 

There  are  two  graphs  for  each  course. 
The  first  shows  the  distribution  for 
final  course  marks  over  the  last  three 
years. 

The  distributions  remained  relatively 
unchanged  over  time  for  all  courses 
except  for  Physics  30,  where  the 
percentage  of  A increased  in  1993-94 
compared  with  the  percentages  in 
1992-93  and  1991-92. 


The  second  of  the  two  graphs  shows 
the  1993-94  school  year  distribution  of 
A,  B,  C,  and  F for  the  school- awarded 
mark,  the  diploma  examination  mark, 
and  the  final  course  mark. 

For  example,  the  awarding  of  F to 
English  33  students  for  the  final  course 
mark  is  much  lower  than  the  awarding 
of  F for  either  the  school-awarded  mark 
or  the  diploma  examination  mark.  One 
reason  for  this  is  that  no  final  marks  of 
48%  or  49%  are  awarded.  If  the 
average  of  the  school-awarded  mark 
and  the  diploma  examination  mark  is 
48%  or  49%,  the  student  is 
automatically  given  50%  as  a final 
mark. 


Figure  2-3 

Average  Number  of  Different  Diploma  Examinations  Written 
by  Students  in  Each  Course 
1993-94  School  Year 


Average  number  of  different 
diploma  examinations  written 
by  all  students  (2.5). 

This  average  is  the  same  as  in 
1992-93  and  1991-92. 


Figure  2-4 


Figure  2-5 


English  30 

Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 


English  30 

Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993-94  School  Year 


School-Awarded  Diploma  Exam  Final  Blended 
Mark  Mark  Mark 


A = 24  494 


^ A (80-100%)  r~lB  (65-79%)  FIC  (50-64%!  ■F(0^9%) 
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Percentage  of  Students  Percentage  of  Students  Percentage  of  Students 


Figure  2-6 

English  33 

Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 


Figure  2-7 

English  33 

Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993-94  School  Year 
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Figure  2-8 

Social  Studies  30 
Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 


Figure  2-9 

Social  Studies  30 
Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993  -94  School  Year 


N = 21  351 


Figure  2-10 

Fran^ais  30 

Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 
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N=84 
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Figure  2-11 
Frangais  30 

Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993-94  School  Year 


A=87 
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Percentage  of  Students  Percentage  of  Students  Percentage  of  Students 


Figure  2-12 

Mathematics  30 
Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 
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Figure  2-13 

Mathematics  30 

Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993  -94  School  Year 
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Figure  2-14 
Biology  30 

Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 


Figure  2-15 
Biology  30 

Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993-94  School  Year 


School-Awarded  Diploma  Exam  Final  Blended 
Mark  Mark  Mark 


A = 17  943 


Figure  2-16 

Chemistry  30 
Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 


1991-92 
A = 16  156 


1992-93 
A = 16  865 


1993-94 
A = 14  424 


Figure  2-17 

Chemistry  30 

Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993-94  School  Year 


A =14  424 
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Figure  2-18 
Physics  30 

Distribution  of  A,  B,  C,  and  F 
for  Final  Course  Mark 
Three  School  Years 


(80-100%)  r~lB  (65-79%) 


Figure  2-19 

Physics  30 

Distribution  of  A,  B,  C,  and  F for  School, 
Examination,  and  Final  Course  Marks 
1993-94  School  Year 


A = 7 488 

n C (50-64%)  ■ F (0^9%) 


For  each  diploma  examination 
course,  what  is  the  correlation 
between  examination  marks  and 
school-awarded  marks? 

Table  2-1  presents  the  correlation 
between  diploma  examination  marks 
and  school-awarded  marks  for  each 
diploma  examination  course. 

The  two  marks  represent  two  separate 
assessments  of  achievement,  each 
based  on  an  overlapping  yet  different 


set  of  curricular  objectives.  To  a large 
degree,  these  objectives  are  similar; 
however,  there  is  a necessary  degree 
of  difference. 

The  diploma  examinations  are  limited 
to  measuring  achievement  of 
objectives  that  can  be  effectively 
assessed  by  paper  and  pencil  tests. 
School  assessments  also  measure 
achievement  of  additional  objectives 
such  as  laboratory  skills  in  the 
sciences,  or  speaking  and  listening 


skills  in  English.  Therefore,  these 
correlations  are  expected  to  be 
positive  and  relatively  high,  but  less 
than  1.0. 

Other  factors  that  contribute  to  the 
less-than-perfect  correlations  include 
variations  among  teachers’  assessment 
practices,  the  longer  time  span  of 
school-based  assessment,  the  effect  of 
failure  to  complete  assignments,  and 
the  individual  student’s  approach  to 
the  different  types  of  assessment. 


Table  2-1 

Correlation  of  Diploma  Examination  Marks  and 
School-Awarded  Marks  by  Course 
1993-94  School  Year 


Course 

Number  of  Students 

Correlation 

Coefficient 

English  30 

24  494 

0.623 

English  33 

11  020 

0.379 

Social  Studies  30 

21  351 

0.756 

Fran9ais  30 

87 

0.576 

Mathematics  30 

20  132 

0.780 

Biology  30 

17  943 

0.806 

Chemistry  30 

14  424 

0.806 

Physics  30 

7 488 

0.777 
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Section  3 

Results  by  Gender 


This  section  of  the  report  provides 

separate  results  for  males  and  females. 

These  questions  will  be  answered; 

• What  proportion  of  males  and 
females  write  diploma  examinations? 

• Is  the  percentage  of  males  and 
females  who  meet  the  standards  the 
same  in  each  course'.’ 

• Are  males  and  females  awarded 
similar  school  marks’’  Is  the  pattern 
the  same  for  diploma  examination 
marks? 


What  proportion  of  males  and 
females  write  diploma 
examinations? 

Of  all  students  registered  in  Grade  12 
on  September  30,  1993,  51%  were 
male.  Figure  3-1  shows,  however,  that 
in  the  1993-94  school  year,  fewer 
males  than  females  wrote  diploma 
examinations  in  all  courses  except 
English  33  and  Physics  30.  The 
reasons  for  this  under-representation 
of  males  among  students  writing  most 
diploma  examinations  cannot  be 
determined  from  the  available  data. 


Schools  that  wish  to  explore  this 

relationship  further  could  look  at: 

• the  percentage  of  males  and  females 
seeking  a high  school  diploma 

• the  percentage  of  males  and  females 
returning  to  school  for  a fourth  year 
of  high  school  and  in  which  courses 
they  are  enrolling 

• the  percentage  of  males  and  females 
who  register  in  a course  but  drop  the 
course  before  writing  a diploma 
examination. 


English  30 
English  33 
Social  Studies  30 
Fran9ais  30 
Mathematics  30 
Biology  30 
Chemistry  30 
Physics  30 


Figure  3-1 

Ratio  of  Males  to  Females  Writing  Diploma  Examinations 
1993-94  School  Year 
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The  vertical  broken  line  shows  the 
percentage  of  all  students  registered 
in  Grade  12  on  September  30,  1993, 
whether  male  (51.0%)  or  female  (49.0%) 
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Is  the  percentage  of  males  and 
females  who  meet  the  standards  the 
same  in  each  course? 

Figure  3-2  shows  that  a higher 
percentage  of  males  achieved  the 
standard  of  excellence  in  their  final 
course  marks  for  Social  Studies  30, 


Mathematics  30,  Biology  30,  and 
Chemistry  30. 

Table  3-1  shows  the  number  of  male 
and  female  students  who  achieved 
standards  in  each  course. 

A higher  percentage  of  females 


achieved  the  standard  of  excellence  in 
their  final  course  marks  in  English  30, 
English  33,  and  Physics  30.  The 
percentage  of  females  who  achieved 
the  acceptable  standard  exceeded  the 
percentage  of  males  in  all  courses 
except  for  Social  Studies  30  and 
Biology  30. 


Figure  3-2 

Percentage  of  Students  Achieving  Standards 
by  Gender  (Final  Course  Mark) 
1993-94  School  Year 


Eng  30  Eng  33  Soc  St  30  Fr  30  Math  30  Bio  30  Chem  30  Phys  30 

Diploma  Examination  Course 


Students  achieving  the  acceptable  standard  Students  achieving  the  standard  of  excellence 

(final  course  mark  of  50%  to  100%).  (final  course  mark  of  80%  to  100%). 


Males  Females 


Males 


Females 


Table  3-1 


Number  of  Students  Achieving  Standards,  by  Gender  (Final  Course  Mark) 
1993-94  School  Year 


Course 

Students  Achieving 
the  Acceptable  Standard 

Students  Achieving 
the  Standard  of  Excellence 

Male 

Female 

Total 

Male 

Female 

Total 

English  30 

10  399 

12  927 

23  326 

985 

1 866 

2 851 

English  33 

5 682 

4 581 

10  263 

124 

268 

392 

Social  Studies  30 

9 615 

10  460 

20  075 

1 772 

1 606 

3 378 

Fran^ais  30 

34 

51 

85 

3 

11 

14 

Mathematics  30 

8 868 

9016 

17  884 

2 026 

1 745 

3 771 

Biology  30 

6 791 

9 455 

16  246 

1 790 

2 330 

4 120 

Chemistry  30 

6 187 

6 682 

12  869 

1 786 

1 617 

3 403 

Physics  30 

4 403 

2 594 

6 997 

1 502 

881 

2 383 
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Are  males  and  females  awarded 
similar  school  marks?  Is  the 
pattern  the  same  for  diploma 
examination  marks? 

Table  3-2  shows  the  results  of  a study 
of  the  school-awarded  marks  and 
diploma  examination  marks  for  males 
and  females.  When  averages  in 
school-awarded  marks  are  compared, 
females  achieved  higher  averages  than 
males  in  all  courses  except  Social 
Studies  30.  In  all  subjects  except 
Social  Studies  30,  the  percentage  of 
females  achieving  an  F was  smaller 
than  the  percentage  of  males.  A 
similar  or  greater  percentage  of 
females  than  males  achieved  an  A in 
all  subjects  except  Chemistry  30  and 


Social  Studies  30. 

In  diploma  examination  marks,  females 
achieved  higher  averages  than  males  in 
English  30,  English  33,  and  Fran^ais  30. 
The  percentage  of  females  achieving  an 
F was  greater  than  the  percentage  of 
males  achieving  an  F in  all  subjects 
except  English  30  and  Physics  30.  A 
smaller  percentage  of  females  than 
males  achieved  an  A on  all  diploma 
examinations  except  for  English  30, 
English  33,  and  Fran9ais  30. 

Noteworthy  differences  between  males 
and  females  occurred  in  English  30, 
Frangais  30,  and  Social  Studies  30.  In 
English  30,  21.4%  of  females  achieved 
an  A based  on  school-awarded  marks. 


but  only  12.6%  of  males  achieved  an 
A.  On  the  diploma  examination  the 
difference  narrowed,  with  1 1.8%  of 
females  and  8.7%  of  males  achieving 
an  A.  In  Social  Studies  30,  even 
though  similar  percentages  of  males 
and  females  achieved  an  F in  school- 
awarded  marks,  20.4%  of  the  females 
compared  with  1 1.7%  of  males 
achieved  an  F in  diploma  examination 
marks. 

In  Fran9ais  30,  48.1%  of  the  females 
achieved  an  A in  school-awarded 
marks  compared  with  14.3%  of  males. 
On  the  diploma  examination,  13.5%  of 
females  and  8.6%  of  males  achieved 
an  A. 


Table  3-2 

Provincial  Percentage  Distribution  of  A,  B,  C,  and  F,  Average,  and  Standard  Deviation*  of  Scores 

1993-94  School  Year 


School-Awarded  Mark 

Diploma  Exam  Mark 

Final 

Course  Mark 

Course 

Total 

Male 

Female 

Total 

Male 

Female 

Total 

Male 

Female 

English  30 

A (80-100%) 

17  4 

12.6 

21.4 

104 

8.7 

11.8 

11.6 

8.9 

13.9 

B (65-79%) 

41  8 

39.3 

43.9 

35.5 

34.1 

36.6 

410 

38.1 

43.5 

C (50-64%) 

33.6 

38.6 

29.4 

41,3 

43.1 

39.9 

42,6 

46.9 

39.0 

F (0-49%) 

7.2 

9.5 

5.3 

12.8 

14.2 

11.7 

4.8 

6.1 

3.6 

Average  (%) 

66.8 

64.5 

68.6 

63.4 

62.5 

64.2 

65.6 

64.0 

66.9 

Standard  Deviation  (%) 

12.5 

12.6 

12.2 

12.4 

12.2 

12.5 

11,2 

11.0 

11.1 

English  33 

A (80-100%) 

6.1 

3.6 

9.4 

5,1 

3.9 

6.7 

3,6 

2.0 

5.5 

B (65-79%) 

32.7 

27.2 

39.8 

37.5 

38.5 

36.1 

36,0 

32.5 

40.4 

C (50-64%) 

48  0 

52.4 

42.3 

42.4 

43.1 

41.4 

53,5 

57.5 

48.7 

F (0-49%) 

13.2 

16.8 

8.5 

15.0 

14.5 

15.7 

6.9 

8.0 

5.4 

Average  (%) 

60.8 

58.6 

63.7 

61.7 

61.6 

61.9 

619 

60.6 

63.4 

Standard  Deviation  (%) 

11.7 

11.4 

11.6 

11.5 

11.2 

11.8 

98 

9.4 

10.0 

Social  Studies  30 

A (80-100%) 

20.8 

20.9 

20.7 

14  5 

16.9 

12.4 

15.8 

17.6 

14.3 

B (65-79%) 

39.3 

38.9 

39.6 

33.7 

37.3 

30.6 

38,2 

39.9 

36.8 

C (50-64%) 

34.5 

35.0 

34.1 

35.5 

34.1 

36.6 

40,0 

37.8 

41.9 

F (0-49%) 

5.4 

5.2 

5.6 

16.3 

11.7 

20.4 

6.0 

4.7 

7.1 

Average  (%) 

67.8 

67.9 

67.8 

63.8 

65.8 

62.0 

66,2 

67.3 

65.2 

Standard  Deviation  (%) 

12.4 

12.3 

14.1 

13.9 

13.4 

14.1 

12,3 

12.0 

12.4 

Fran9ais  30** 

A (80-100%) 

34.5 

14.3 

48.1 

11.5 

8.6 

13.5 

16;1 

8.6 

21.2 

B (65-79%) 

39.1 

45.7 

34.6 

40.2 

31.4 

46.2 

48.3 

34.3 

57.7 

C (50-64%) 

19.5 

25.7 

15.4 

36.8 

48.6 

28.8 

33,3 

54.3 

19.2 

F (0-49%) 

6.9 

14.3 

1.9 

11.5 

11.4 

11.5 

2.3 

2.9 

1.9 

Average  (%) 

72.2 

65.9 

76.4 

64.4 

60.5 

67.1 

68.6 

63.5 

72.0 

Standard  Deviation  (%) 

13,3 

13.6 

11.3 

13.2 

12.7 

13.0 

11,8 

11.6 

10.7 

(continued) 
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Table  3-2  {continued) 


School-Awarded  Mark 

Diploma  Exam  Mark 

Final  Course  Mark 

Course 

Total  Male 

Female 

Total 

Male 

Female 

Total 

Male 

Female 

Mathematics  30 

A (80-100%) 

25.2 

25.1 

25.4 

16.7 

18.7 

14.6 

18.7 

20.2 

17.2 

B (65-79%) 

34.9 

33.4 

36.3 

27.5 

27.6 

27.4 

33.1 

32.1 

.34.1 

C (50-64%) 

31.4 

32.1 

30.8 

31.0 

30.0 

32.0 

37.0 

36.2 

37.8 

F (0-49%) 

8.5 

9.4 

7.5 

24.8 

23.7 

26.0 

11.2 

11.4 

10.9 

Average  (%) 

68.3 

67.9 

68.7 

61.7 

62.6 

60.9 

65.4 

65.6 

65.1 

Standard  Deviation  (%) 

14.3 

14.7 

13.9 

16.6 

16.9 

16.2 

14.5 

14.9 

14.2 

Biology  30 

A (80-100%) 

23.6 

22.9 

24.2 

23.2 

25.8 

21.4 

23.0 

24.0 

22.2 

B (65-79%) 

36.5 

35.4 

37.3 

30.5 

31.1 

30.1 

33.8 

33.9 

33.9 

C (50-64%) 

32,1 

33.0 

31.4 

27.7 

27.3 

28.0 

33.7 

33.1 

34.1 

F (0-49%) 

7.8 

8.7 

7.1 

18.6 

15.9 

20.5 

9.5 

9.0 

9.8 

Average  (%) 

68.0 

67.4 

68.4 

65.5 

66.9 

64.5 

67.2 

67.6 

66.9 

Standard  Deviation  (%) 

13,6 

13.9 

13.4 

16.5 

16.3 

16.6 

14.4 

14.4 

14.3 

Chemistry  30 

A (80-100%) 

26.4 

27.1 

25.8 

22;9 

25.3 

20.6 

23.6 

25.6 

21.7 

B (65-79%) 

36  7 

34.8 

38.3 

27.9 

27.3 

28.4 

34.0 

32.3 

35.7 

C (50-64%) 

29,1 

29.3 

29.0 

28.8 

27.1 

30.4 

31,6 

30.9 

32.2 

F (0-49%) 

7.8 

8.8 

6.9 

20.4 

20.2 

20.5 

10.8 

11.2 

10.4 

Average  (%) 

68.9 

68.7 

69.1 

64.5 

65.2 

63.9 

67.2 

67.4 

66.9 

Standard  Deviation  (%) 

14.0 

14.5 

13.6 

17.2 

17.8 

16.7 

14.9 

15.4 

14.4 

Physics  30 

A (80-100%) 

34  2 

32.2 

37.7 

32.3 

32.5 

31.9 

31.8 

31.5 

32.3 

B (65-79%) 

37  8 

36.7 

39.7 

29.1 

28.0 

31.2 

35.7 

33.8 

39.1 

C (50-64%) 

23,4 

25.4 

19.9 

23.4 

22.9 

24.3 

25,9 

27.1 

23.7 

F (0-49%) 

4.6 

5.6 

2.6 

15.2 

16.6 

12.7 

6.6 

7.6 

4.8 

Average  (%) 

72,1 

71.1 

73.8 

68.9 

68.5 

69.4 

70,9 

70.3 

72.0 

Standard  Deviation  (%) 

134 

13.9 

12.3 

17.2 

17.7 

16.2 

14.5 

15.0 

13.4 

*Standard  deviation  is  an  indication  of  the  amount  of  variation  in  a distribution.  About  68%  of  the  students’  marks  will  fall  within  plus  or 
minus  one  “standard  deviation”  of  the  average  mark.  On  the  English  30  Diploma  Examination,  for  example,  68%  of  students  who  wrote 
the  examination  scored  between  51.0%  and  75.8% 

**Because  very  few  students  wrote  the  Frangais  30  examinations,  results  must  be  interpreted  with  caution. 


Summary 


There  are  gender  differences  in  the 
marks  obtained  for  the  diploma 
examination  courses.  A larger 
proportion  of  females  than  males  are 
writing  the  diploma  examinations  and 
obtaining  a high  school  diploma. 
Although  the  achievement  of  females 
is  similar  to  or  higher  than  the 
achievement  of  males  in  school- 
awarded  marks,  their  achievement  on 
many  of  the  diploma  examinations  is 
below  the  achievement  of  males. 


Since  individual  jurisdiction  results 
will  show  patterns  that  differ  from  the 
province-wide  results,  school  boards 
are  encouraged  to  explore  gender 
differences  in  their  own  jurisdictions. 

The  data  presented  in  this  section  show 
gender  differences  to  a greater  or 
lesser  degree  in  all  diploma 
examination  courses.  Schools  should 
consider  these  results  carefully  within 
their  own  contexts. 


We  welcome  any  comments  regarding 
observations  or  thoughts  you  have  on 
gender  differences  in  achievement.  If 
you  would  like  to  share  your  thoughts 
with  us,  please  contact  Elana  Scraba, 
Assistant  Director,  Humanities 
Diploma  Examinations  Program,  at 
(403)  427-0010  or  write  to  her  at 
Student  Evaluation  Branch,  Alberta 
Education,  11160  Jasper  Avenue, 
Edmonton,  Alberta  T5K  0L2. 
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Section  4 

Results  for  Population  Subgroups 


The  majority  of  students  who  wrote 
the  1993-94  diploma  examinations 
took  the  course  in  school  as  regular 
students;  the  second  largest  group 
were  mature  students*  with  current 
school-awarded  marks.  Results  for 
students  with  both  school-awarded 
marks  and  diploma  examination  marks 
are  reported  in  sections  2 and  3 of  this 
report. 

This  section  reports  the  results  for  all 
students,  including  those  with  no 
school-awarded  marks.  Subgroup 
definitions  and  results  are  reported. 


This  section  will  answer  these 

questions: 

• Does  the  percentage  of  mature 
students  writing  diploma 
examinations  vary  across  courses? 

• How  does  the  performance  of  mature 
students  with  current  school-awarded 
marks  compare  with  the  performance 
of  regular  students  with  current 
school-awarded  marks? 

• How  does  the  performance  of 
students  with  school  marks  brought 


forward  compare  with  the  results 
of  students  with  current  school- 
awarded  marks? 

• How  does  the  performance  of  mature 
students  challenging  the  examination 
compare  with  the  performance  of 
other  mature  student  subgroups? 

• For  subgroups  with  current  school- 
awarded  marks  and  diploma 
examination  marks,  how  does  the 
diploma  examination  mark  average 
compare  with  the  school-awarded 
mark  average? 


Subgroup  Definitions 

Subgroups  are  defined  by  a 
combination  of  mature  student  status 
and  school-awarded  mark  status. 
Students  in  all  subgroups  have  a 
current  diploma  examination  mark. 
The  subgroups  are: 

• Regular  School:  Students  with  a 
current  school-awarded  mark.  This 
group  comprises  regular 
students  and  mature  students. 

Regular  Students  are  students 
without  mature  status  who  have  a 
current  school-awarded  mark. 

Mature  Students  are  students  with 
mature  status  who  have  a current 
school-awarded  mark. 

• Regular  Students,  School  Mark 
Brought  Forward:  Regular 
students  who  do  not  have  a current 
school-awarded  mark  but  have  an 
earlier  school-awarded  mark. 

• Mature  Students,  School  Mark 
Brought  Forward:  Mature  students 
who  do  not  have  a current  school- 
awarded  mark  but  have  an  earlier 
school-awarded  mark. 


• Mature  Students,  Challenging 
Examination:  Students  with  mature 
status  who  have  no  school-awarded 
mark. 

• Regular  Students,  No  School 
Mark:  Regular  students  who  have 
no  school-awarded  mark. 

Note: 

1.  Mature  students  “challenging”  a 
diploma  examination  do  not  take 
the  course  but  receive  course 
credit  if  they  pass  the 
examination;  regular  students 
with  no  school-awarded  mark 
receive  no  course  credit. 

2.  When  a mature  student  earns  a 
diploma  examination  mark  that  is 
higher  than  that  student’s  school- 
awarded  mark,  the  diploma 
examination  mark  becomes  the 
final  course  mark;  otherwise,  the 
normal  blending  is  applied  to 
calculate  the  final  course  mark. 


Excluded  Groups 

Not  included  in  any  of  the  subgroups 
are  students  who  were  exempted  from 
all  or  part  of  the  examination  or  who 


wrote  a substantially  different  form  of 
the  examination  because  of  special 
considerations.  Students  in  English  30 
or  English  33  who,  by  special 
permission,  wrote  the  two  parts  of  the 
examination  in  two  different 
examination  sittings  (e.g,,  January  and 
June)  are  also  excluded.  Very  few 
students  fall  into  these  categories. 

Results  for  Fran^ais  30  are  not 
included  because  of  the  small  number 
of  students  writing  the  examination. 

Results 

Three  tables  are  provided  for  each 
diploma  examination  course.  In  the 
first  table  are  the  number  and 
percentage  of  regular  and  mature 
students  writing.  In  the  second  table 
are  the  number  of  students  in  each 
subgroup,  their  average  diploma 
examination  mark,  and  standard 
deviations  of  diploma  examination 
marks  for  all  subgroups.  The  third 
table  provides  data  for  subgroups  with 
school-awarded  marks.  It  includes  the 
number  of  students  in  each  subgroup, 
their  average  school-awarded  mark, 
and  the  standard  deviation  of  school- 
awarded  marks  for  these  subgroups. 


* A student  with  mature  status  is  one  who,  as  of  September  1 of  the  current  school  year,  is  20  years  of  age  or  older  or  is  19  years  of  age  and 
has  been  out  of  school  for  eight  consecutive  months  since  reaching  the  age  of  18  or  is  the  holder  of  a previously  awarded  Alberta  high 
school  diploma  or  equivalent  (see  the  Guide  to  Education,  Senior  High  School  Handbook,  1993-94,  page  82). 
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English  30: 1993-94  School  Year 


Achievement  in  English  30  by 
subgroups  is  compared  in  Tables  4-1  to 
4-3.  About  one  in  five  English  30 
students  who  wrote  the  1 993-94 
diploma  examinations  had  mature  status. 

Of  students  with  current  school-awarded 
marks,  regular  students  achieved  higher 


averages  in  both  school-awarded 
marks  and  diploma  examination  marks 
than  did  mature  students. 

Among  all  subgroups,  regular  students 
with  current  school-awarded  marks 
achieved  the  highest  average  in 
diploma  examination  marks  while 


mature  students  with  school  marks 
brought  forward  achieved  the  lowest 
average. 


Table  4-1 

Elnglish  30 

Status  of  Students  Writing 


Type  of  Student 

.Number  of 
.Students 

Percentage 

Regular  Students 

20  -167 

80.6 

Mature  Student.^' 

•1  91.T 

19.4 

Total 

2.7  :iH2 

100.0 

Table  4-2 
English  30 

Diploma  Examination  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 

23  493 

63.6 

12.4 

Regular  Students 

19  564 

64.2 

12.2 

Mature  Students 

3 929 

60.4 

12.7 

Regular  Students,  School 
Mark  Brought  Forward 

699 

61.9 

12.3 

Mature  Students,  School 
Mark  Brought  Forward 

302 

56.5 

11.4 

Mature  Students, 
Challenging  Examination 

684 

60.2 

14.5 

Regular  Students, 
No  School  Mark 

204 

63.3 

15.7 

Table  4-3 
English  30 

School-Awarded  Marks  for  Population  Subgroups 


Number  of 

Standard 

Subgroup 

Students 

Average 

Deviation* 

All  Regular  School 
Regular  Students 

23  493 
19  564 

66.8 

67.4 

12.5 

12.3 

Mature  Students 
Regular  Students,  School  Mark 

3 929 

64.1 

13.2 

Brought  Forward 

699 

65.4 

13.6 

Mature  Students,  School  Mark 

Brought  Forward 

302 

64.9 

11.2 

*For  an  explanation  of  standard  deviation,  see  footnote  to  Table  3-2. 
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English  33: 1993-94  School  Year 


Achievement  in  English  33  by 
subgroups  is  compared  in  Tables  4-4  to 
4-6.  About  one  in  five  English  33 
students  who  wrote  the  1993-94 
diploma  examinations  had  mature  status. 

Of  students  with  current  school-awarded 
marks,  mature  students  achieved  a 


higher  average  in  school-awarded 
marks  than  regular  students  did; 
however,  regular  students  achieved  a 
slightly  higher  average  on  the  diploma 
examination  than  did  mature  students. 

Among  all  subgroups,  mature  students 
challenging  examinations  achieved  the 


highest  average  in  diploma 
examination  marks.  Subgroups  with 
school  marks  brought  forward 
achieved  much  lower  averages  in 
diploma  examination  marks  compared 
with  the  other  subgroups. 


Table  4-4 

English  33 

Status  of  Students  Writing 


Type  of  Student 

Number  of 
Students 

Percentage 

Regular  Students 

9 280 

78.8 

Mature  Students 

2 502 

21.2 

Total 

11782 

100.0 

Table  4-5 
English  33 

Diploma  Examination  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 

10  766 

62.0 

11.4 

Regular  Students 

8 942 

62.:1:;::.:::,;: 

10.8 

Mature  Students 

1824 

61.5 

13.9 

Regular  Students,  School 
Mark  Brought  Forward 

174 

53.3 

11.0 

Mature  Students,  School 
Mark  Brought  Forward 

80 

49.0 

10.3 

Mature  Students, 

Challenging  Examination 

598 

63.5 

12.9 

Regular  Students, 
No  School  Mark 

164 

62.9 

12.4 

Table  4-6 
English  33 

School- A warded  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regvdar  School 
Regular  Students 

10  766 
8 942 

61.0 

60.4 

11.7 

11.3 

Mature  Students 
Regular  Students,  School  Mark 

1824 

63.8 

131 

Brought  Forward 

174 

53.4 

11.1 

Mature  Students,  School  Mark 

Brought  Forward 

80 

58.9 

10.2 

*For  an  explanation  of  standard  deviation,  see  footnote  to  Table  3-2. 
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Social  Studies  30: 1993-94  School  Year 


Achievement  in  Social  Studies  30  by 
subgroups  is  compared  in  Tables  4-7  to 
4-9.  About  one  in  eight  Social  Studies 
30  students  who  wrote  the  1993-94 
diploma  examinations  had  mature 
status. 

Of  students  with  current  school- 
awarded  marks,  regular  students 


achieved  higher  averages  in  both 
school-awarded  marks  and  diploma 
examination  marks  than  did  mature 
students. 

Among  all  subgroups,  regular  students 
with  current  school-awarded  marks 
achieved  the  highest  average  on  the 
examination.  Subgroups  with  no 


current  school-awarded  marks 
achieved  much  lower  averages  in 
diploma  examination  marks  than  did 
regular  school  subgroups. 


Table  4-7 


Table  4-8 


Social  Studies  30 

Status  of  Students  Writing 


Type  of  Student 

Number  of 
Students 

Percentage 

Regular  Students 

19  104 

88.0 

Mature  Students 

2 607 

12.0 

Total 

21  711 

100.0 

Social  Studies  30 

Diploma  Examination  Marks  for  Population  Subgroups 


Number  of 

Standard 

Subgroup 

Students 

Average 

Deviation* 

All  Regular  School 

20  807 

64.0 

13.8 

Regular  Students 

64.5 

13.7 

lO  ooo 

Mature  Students 

2 254 

59.8 

14.0 

Regular  Students,  School 

Mark  Brought  Forward 

451 

57.9 

14.2 

Mature  Students,  School 

Mark  Brought  Forward 

93 

53.6 

12.1 

Mature  Students, 

Challenging  Examination 

260 

54.0 

17.0 

Regular  Students, 

No  School  Mark 

100 

55.9 

16.3 

Table  4-9 

Social  Studies  30 

School-Awarded  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 
Regular  Students 

20  807 
18  553 

68.0 

68.4 

12.3 

12.2 

Mature  Students 
Regular  Students,  School  Mark 

2 254 

64,9 

13.1 

Brought  Forward 

451 

62.0 

13.6 

Mature  Students,  School  Mark 

Brought  Forward 

93 

63.4 

10.6 

*For  an  explanation  of  standard  deviation,  see  footnote  to  Table  3-2. 
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Mathematics  30: 1993-94  School  Year 


Achievement  in  Mathematics  30  by 
subgroups  is  compared  in  Tables  4-10 
to  4-12.  About  one  in  five 
Mathematics  30  students  who  wrote 
the  1993-94  diploma  examinations 
had  mature  status. 

Of  students  with  current  school- 


awarded  marks,  regular  students 
achieved  higher  averages  in  both 
school-awarded  marks  and  diploma 
examination  marks  than  did  mature 
students. 

Among  all  subgroups,  regular  students 
with  school  marks  brought  forward 


achieved  the  highest  average  on  the 
diploma  examination  while  mature 
students  challenging  examinations  and 
regular  students  with  no  school  marks 
achieved  the  lowest  averages. 


Table  4-10 

Mathematics  30 

Status  of  Students  Writing 


Type  of  Student 

Number  of 
Students 

Percentage 

Regular  Students 

16  384 

80.2 

Mature  Students 

4 053 

19.8 

Total 

20  437 

100.0 

Table  4-11 
Mathematics  30 

Diploma  Examination  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 

19  218 

61.6 

16.5 

Regular  Students 

15  588 

62.4 

16.6 

Mature  Students 

3 630 

58.3 

Regular  Students,  School 
Mark  Brought  Forward 

715 

66.8 

16.4 

Mature  Students,  School 
Mark  Brought  Forward 

198 

52.6 

17.1 

Mature  Students, 
Challenging  Examination 

225 

45.1 

19.7 

Regular  Students, 
No  School  Mark 

81 

47.4 

18.0 

Table  4-12 
Mathematics  30 

School- A warded  Marks  for  Population  Subgroups 


Number  of 

Standard 

Subgroup 

Students 

Average 

Deviation* 

All  Regular  School 

19  218 

68.2 

14.2 

Regular  Students 

15  688 

68.6 

Mature  Students 
Regular  Students,  School  Mark 

3 630 

66.8 

Brought  Forward 

715 

71.5 

15.1 

Mature  Students,  School  Mark 

Brought  Forward 

198 

64.2 

14.6 

*For  an  explanation  of  standard  deviation,  see  footnote  to  Table  3-2. 
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Biology  30: 1993-94  School  Year 


Achievement  in  Biology  30  by 
subgroups  is  compared  in  Tables  4-13 
to  4-15.  About  one  in  five  Biology  30 
students  who  wrote  the  1993-94 
diploma  examinations  had  mature 
status. 

Of  students  with  current  school- 


awarded  marks,  mature  students 
achieved  a slightly  higher  average  in 
school-awarded  marks  but  slightly 
lower  average  in  diploma  examination 
marks  than  did  regular  students. 

Among  all  subgroups,  students  with 
current  school-awarded  marks 


achieved  the  highest  average  on  the 
diploma  examination.  Mature  students 
with  school  marks  brought  forward 
achieved  the  lowest  average  on  diploma 
examination  marks. 


Table  4-13 
Biology  30 

Status  of  Students  Writing 


Type  of  Student 

Number  of 
Students 

Percentage 

Regular  Students 

14  528 

79.0 

Mature  Students 

3 852 

21.0 

Total 

18  380 

100.0 

Table  4-14 

Biology  30 

Diploma  Examination  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 

17  433 

65.8 

16.4 

Regular  Students 

14  069 

65.9 

16.4 

Mature  Students 

3 364 

65.2 

16.5 

Regular  Students,  School 

Mark  Brought  Forward 

349 

56.1 

16.5 

Mature  Students,  School 

Mark  Brought  Forward 

161 

51.3 

14.6 

Mature  Students, 

Challenging  Examination 

327 

55.2 

19.5 

Regular  Students, 

No  School  Mark 

110 

51.9 

15.5 

Table  4-15 
Biology  30 

School-Awarded  Marks  for  Population  Subgroups 


Number  of 

Standard 

Subgroup 

Students 

Average 

Deviation* 

All  Regular  School 
Regular  Students 

17  433 
14  069 

68.2 

68.0 

13.6 

13.5 

Mature  Students 
Regiilar  Students,  School  Mark 

3 364 

68.9 

13.9 

Brought  Forward 

349 

60.5 

14.1 

Mature  Students,  School  Mark 

Brought  Forward 

161 

63.7 

12.0 

*For  an  explanation  of  standard  deviation,  see  footnote  to  Table  3-2. 
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Chemistry  30: 1993-94  School  Year 


Achievement  in  Chemistry  30  by 
subgroups  is  compared  in  Tables  4-16 
to  4-18.  About  one  in  five  Chemistry  30 
students  who  wrote  the  1993-94 
diploma  examinations  had  mature 
status. 

Of  students  with  current  school- 


awarded  marks,  regular  students 
achieved  slightly  higher  averages  in 
both  school-awarded  marks  and 
diploma  examination  marks  than  did 
mature  students. 

Among  all  subgroups,  regular  students 
with  current  school-awarded  marks 


achieved  the  highest  average  in 
diploma  examination  marks. 
Subgroups  with  no  current  school 
marks,  except  regular  students  with 
school  marks  brought  forward, 
achieved  much  lower  averages  than 
did  regular  school  subgroups. 


Table  4-16 

Chemistry  30 

Status  of  Students  Writing 


Type  of  Student 

Number  of 
Students 

Percentage 

Regular  Students 

11  765 

80.2 

Mature  Students 

2 905 

19.8 

Total 

14  6707 

100.0 

Table  4-17 
Chemistry  30 

Diploma  Examination  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 

14  063 

64.6 

17.2 

Regular  Students 

;;:64;9-;:i 

17.4 

Mature  Students 

63.5 

16  3 

Regular  Students,  School 
Mark  Brought  Forward 

267 

63.3 

18.3 

Mature  Students,  School 
Mark  Brought  Forward 

94 

56.0 

15.0 

Mature  Students, 

Challenging  Examination 

165 

50.1 

20.6 

Regular  Students, 
No  School  Mark 

81 

51.6 

21.4 

Table  4-18 
Chemistry  30 

School-Awarded  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 

14  063 

68.9 

14.0 

Regular  Students 

11417 

69.0 

14.0 

Mature  Students 

2 646 

68.5 

14A 

Regular  Students,  School  Mark 
Brought  Forward 

Mature  Students,  School  Mark 
Brought  Forward 

267 

94 

68.4 

66.9 

15.1 

13.3 

*For  an  explanation  of  standard  deviation,  see  footnote  to  Table  3-2. 
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Physics  30: 1993-94  School  Year 


Achievement  in  Physics  30  by 
subgroups  is  compared  in  Tables  4-19 
to  4-21.  About  one  in  six  Physics  30 
students  who  wrote  the  1993-94 
diploma  examinations  had  mature 
status. 

For  students  with  current  school- 
awarded  marks,  regular  students 


achieved  higher  averages. in  both 
school-awarded  marks  and  diploma 
examination  marks  than  did  mature 
students. 

Among  all  subgroups,  regular  students 
with  current  school-awarded  marks 
achieved  the  highest  average  on  the 
diploma  examination. 


Subgroups  with  no  current  school 
marks,  except  regular  students  with 
school  marks  brought  forward, 
achieved  much  lower  averages  in 
diploma  examination  marks  than  did 
subgroups  with  current  school 
marks. 


Table  4-19 

Physics  30 

Status  of  Students  Writing 


Type  of  Student 

Number  of 
Students 

Percentage 

Regular  Students 

6 378 

83.5 

Mature  Students 

1260 

16.5 

Total 

7 638 

100.0 

Table  4-20 
Physics  30 

Diploma  Examination  Marks  for  Population  Subgroups 


Subgroup 

Number  of 
Students 

Average 

Standard 

Deviation* 

All  Regular  School 

7 286 

69.0 

17.2 

Regular  Students 
Mature  Students 

6 178 

69.5 

17.2 

1 108 

66.3 

16.8 

Regular  Students,  School 
Mark  Brought  Forward 

151 

67.0 

18.7 

Mature  Students,  School 
Mark  Brought  Forward 

51 

57.0 

16.6 

Mature  Students, 

Challenging  Examination 

101 

50.8 

20.5 

Regular  Students, 
No  School  Mark 

49 

58.1 

23.9 

Table  4-21 
Physics  30 

School- Awarded  Marks  for  Population  Subgroups 


Number  of 

Standard 

Subgroup 

Students 

Average 

Deviation* 

All  Regular  School 
Regular  Students 

7 286 

. : JT78:J::;:^  ::V 

72.1 

13.4 

13.3 

Mature  Students 
Regvdar  Students,  School  Mark 

1 108 

. 

13.6 

Brought  Forward 

151 

72.5 

13.9 

Mature  Students,  School  Mark 

Brought  Forward 

51 

68.2 

13.6 

*For  an  explanation  of  standard  deviation,  see  footnote  to  Table  3-2. 
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Does  the  percentage  of  mature 
students  writing  diploma 
examinations  vary  across  courses? 

In  1993-94,  the  percentage  of  mature 
students  writing  examinations  ranged 
from  12.0%  in  Social  Studies  30  to 
21.2%  in  English  33. 

How  does  the  performance  of  mature 
students  with  current  school-awarded 
marks  compare  with  the  performance 
of  regular  students  with  current 
school-awarded  marks? 

In  1993-94,  average  marks  on  diploma 
examinations  for  regular  students  with 
current  school-awarded  marks  was 
higher  than  the  averages  tor  mature 
students  with  current  school -awarded 
marks  in  all  courses. 

How  does  the  performance  of 
students  with  school  marks  brought 


Summary 

forward  compare  with  the  results  of 
students  with  current  school- 
awarded  marks? 

On  the  1994  diploma  examinations, 
students  with  school  marks  brought 
forward  achieved  lower  averages  in  all 
courses  except  in  Mathematics  30  than 
did  students  with  current  school- 
awarded  marks. 

In  Mathematics  30,  regular  students 
with  school  marks  brought  forward 
achieved  the  highest  average. 


How  does  the  performance  of 
mature  students  challenging  the 
examination  compare  with  the 
performance  of  other  mature 
student  subgroups? 

On  the  1994  diploma  examinations, 
mature  students  challenging  the 
diploma  examination  achieved  the 
highest  average  in  English  33  but  the 


lowest  averages  in  Mathematics  30, 
Chemistry  30,  and  Physics  30. 

For  subgroups  with  current  school- 
awarded  marks  and  diploma 
examination  marks,  how  does  the 
diploma  examination  mark  average 
compare  with  the  school-awarded 
mark  average? 

Both  subgroups  had  higher  averages  in 
school-awarded  marks  than  in  diploma 
examination  marks,  with  the  exception 
of  English  33.  In  English  33,  regular 
students  achieved  a higher  average  in 
diploma  examination  marks  than  they 
did  in  school-awarded  marks.  The 
largest  differences  were  found  in 
Mathematics  30  where  the  averages  for 
school-awarded  marks  were  6.1%  and 
8.5%  higher  than  the  averages  for 
diploma  examination  marks  for  regular 
students  and  mature  students 
respectively. 
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Section  5 

Special  Study:  Participation  Rates  over  Time 


A Comparison  of 
Provincial  Participation 
Rates  in  Diploma 
Examination  Subjects 
for  the  School  Years 
1991-92, 1992-93,  and 
1993-94 

The  special  study  in  the  Annual  Report 
on  the  Diploma  Examinations  Program 
for  the  school  year  1991-92  dealt  with 
participation  rates  in  diploma 
examination  courses.  Since  that  year, 
annual  reports  have  been  provided  to 
schools  and  jurisdictions,  giving  their 
participation  rates  and  provincial 
participation  rates. 

Defining  Participation 

The  percentage  of  students  taking  a 
particular  course,  out  of  those  who 
could  take  the  course,  is  called  the 
participation  rate.  For  the  school  and 
jurisdiction  participation  rate  reports, 
“those  who  could  take  the  course”  is 
defined  in  three  different  ways: 

• The  September  30  Grade  12 
enrollment  reported  for  grants 
purposes  for  that  school  year 

• The  September  30  Grade  1 1 
enrollment  reported  for  grants 
purposes  for  the  preceding  school 
year 

• First-time  Grade  12  English 
completion  (the  total  number  of 
students  completing  either  English 
30  or  English  33  for  the  first  time, 
with  students  taking  both  counted 
only  once) 

Depending  on  the  circumstances  in  a 
particular  school  or  jurisdiction,  any 
one  of  these  definitions  could  be  more 
appropriate  than  the  others.  For 
provincial  reporting  purposes,  all  are 
appropriate. 


Students  Included 

As  discussed  in  the  1991-92  special 
study,  the  analysis  must  be  based  on 
students  who  are  representative  of  a 
definable  and  coherent  population. 

The  typical  student  attends  a public  or 
separate  high  school  in  his  or  her 
jurisdiction  after  completing  junior 
high  school,  along  with  other  students 
who  are  from  the  same  community 
and  are  approximately  the  same  age. 
Some  students  attend  private  schools; 
these  students  are  selected  in  various 
ways  before  entering  the  school. 

Other  students  return  to  school  after 
an  absence  of  some  time;  the 
enrollment  of  some  schools  consists 
mainly  of  this  type  of  student.  These 
adult  students  will  have  selected 
courses  to  meet  individual  needs  that 
are  different  from  those  of  the  typical 
student. 

Schools  Included  and  Excluded 

Participation  rates  in  private  schools 
and  schools  dealing  primarily  with 
adult  students  have  quite  a different 
meaning  than  participation  rates  in 
schools  where  most  students  fall  into 
the  typical  pattern.  Thus,  provincial 
figures  exclude  private  schools  and 
schools  where  more  than  half  of  the 
students  have  mature  status.  (For  a 
definition  of  mature  status,  see  Section 
4.)  Also  excluded  are  schools  not 
receiving  provincial  grants.  After 
exclusion,  there  were  279  schools  in 
1991-92,  281  schools  in  1992-93,  and 
282  schools  in  1993-94  included  in 
the  calculation  of  provincial  figures. 

Courses  Included  and  Excluded 

If  a student  withdrew  from  a course 
and  did  not  receive  a final  mark,  the 
course  could  not  be  included.  If  a 
student  took  a course  in  the  preceding 
year  and  was  taking  it  again  in  the 
year  reported,  the  student  was  not 


considered  to  have  participated  in  the 
course  for  the  reported  year.  Courses 
taken  from  the  Alberta  Distance 
Learning  Centre  were  also  excluded, 
as  the  ADLC  does  not  fit  the 
definition  of  a typical  school  given 
earlier.  Courses  taken  by  private 
study  were  excluded,  as  no  school  was 
involved.  Participation  rates  for 
Fran^ais  30  were  not  calculated 
because  of  the  restricted  availability  of 
the  course. 

In  the  1993-94  school  year,  many 
schools  used  the  pilot  versions  of  the 
Biology  30,  Chemistry  30,  and 
Physics  30  courses.  Students  taking 
these  versions  were  exempt  from  the 
diploma  examinations  in  those 
subjects,  as  the  examinations  were 
based  on  the  current  curriculum.  To 
provide  a more  accurate  reflection  of 
course  participation,  students  taking 
pilot  versions  of  these  courses  have 
been  included  in  the  1993-94 
participation  rates,  although  they  are 
not  included  in  other  sections  of  this 
report. 

Results 

Figure  5-1  shows  how  the  student 
counts  have  varied  in  the  three  years 
of  the  study.  The  relationship  of  the 
counts  has  not  remained  constant. 

September  Grade  1 2 enrollments 
increased  at  twice  the  rate  between  the 
first  two  years  compared  to  the 
increase  between  the  second  and  third 
year,  previous-year  Grade  1 1 
enrollments  increased  at  a regular 
pace,  and  first-time  Grade  12  English 
Completions  actually  declined  and 
then  recovered  to  the  earlier  level. 

Because  of  the  shifting  relationships, 
trends  in  participation  over  time 
depend  on  the  method  used  to  identify 
the  population. 
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Tables  5-1  to  5-3  show  the  participation 
rates  in  diploma  examination  courses 
for  the  last  three  years  with  the  three 
different  methods. 

Table  5-1,  based  on  first-time  Grade  12 
English  completions,  shows  relatively 
little  change  in  participation  in  all 
courses,  except  Biology  30  and 
Chemistry  30.  Some  students  may  have 
taken  the  pilot  versions  of  Science  30 
when  it  was  offered,  rather  these  two 
courses. 

Table  5-2,  based  on  previous-year 


Grade  1 1 enrollment,  shows  declining 
participation  in  all  courses  except 
English  33,  although  the  decline  in 
Physics  30  is  small.  Table  5-3,  based  on 
Grade  12  enrollment,  shows  a similar 
picture. 

One  explanation  for  the  inconsistencies 
in  the  trends  is  that  more  students  in 
1992-93  and  1993-94  could  have  been 
taking  more  than  one  year  to  take  the 
full  set  of  Grade  12  courses  that  they 
wished  to  include  in  their  program. 

Some  of  these  students  perhaps  delayed 
taking  a Grade  12  English  course  until 


their  second  year,  which  would  cause 
a dip  in  the  number  of  students 
completing  a Grade  12  English  course 
for  the  first  time  in  1992-93.  Thus, 
there  has  been  httle  change  in  the  sets 
of  courses  students  are  completing, 
but  the  average  number  of  years  to 
take  that  set  of  courses  has  increased. 
Another  possibility  is  an  increase  in 
the  number  of  students  returning  for 
additional  years  in  Grade  12;  the  two 
factors  resulting  in  a steady  number  of 
first-year  Grade  1 2 students  and  no 
essential  change  in  participation. 


Figure  5-1 

Comparison  of  Provincial  Student  Counts  Over  Time  in  Selected  Schools, 
Based  on  Three  Counting  Methods 


# Sept.  Grade  12  enrollment 

1 Sept,  previous-year  enrollment  Grade  1 1 

-A-  • — First-time  Grade  12  English  Completion 
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Table  5-1 


Diploma  Examination  Participation  Rates  in  Percent, 
Based  on  First-time  Grade  12  English  Completion 


Course 

1991-92 

1992-93 

1993-94 

English  30 

71.4 

72.7 

70.9 

English  33 

30.3 

31.9 

33.1 

Social  Studies  30 

68.1 

68.0 

66.9 

Mathematics  30 

54.9 

55.8 

55.5 

Biology  30 

58.9 

62.2 

55.7 

Chemistry  30 

47.1 

49.6 

45.7 

Physics  30 

24.9 

26.0 

25.8 

Table  5-2 


Diploma  Examination  Participation  Rates  in  Percent, 
Based  on  Previous-year  Grade  11  Enrollment 


Course 

1991-92 

1992-93 

1993-94 

English  30 

61.4 

57.7 

56.0 

English  33 

26.0 

25.3 

26.1 

Social  Studies  30 

58.5 

54.0 

52.8 

Mathematics  30 

47.1 

44.3 

43.8 

Biology  30 

50.6 

49.4 

44.0 

Chemistry  30 

40.5 

39.4 

36.1 

Physics  30 

21.4 

20.6 

20.3 

Table  5-3 

Diploma  Examination  Participation  Rates  in  Percent, 
Based  on  Grade  12  Enrollment 


Course 

1991-92 

1992-93 

1993-94 

English  30 

49.2 

45.6 

44.5 

English  33 

20.8 

20.0 

20.6 

Social  Studies  30 

46.9 

42.6 

42.0 

Mathematics  30 

37.8 

35.0 

34.8 

Biology  30 

40.5 

39.0 

34.9 

Chemistry  30 

32.4 

31.1 

28.7 

Physics  30 

17.1 

16.3 

16.1 
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Section  6 

Achievement-Over-Time  Studies 


An  important  goal  of  Alberta 
Education  is  to  answer  the  question: 

Has  student  achievement,  as 
measured  by  the  diploma 
examinations,  changed  over  the 
past  few  years? 

To  answer  this  question,  an  anchor  test 
technique  is  used. 

Comparing  achievement  among 
groups  of  students  requires  some 
common  measure.  Because  new 
diploma  examinations  are  developed 
each  year,  it  is  not  possible  to  make 
direct  comparisons  of  achievement 
from  one  year  to  the  next.  Re- 
administration of  old  diploma 
examinations  does  not  give  an 
accurate  indication  of  changes  to 
student  performance  since  students 
use  old  examinations  for  practice. 

Machine-scorable  anchor  tests  are 
designed  and  developed  to  be  parallel 
to  the  machine-scorable  components 
of  each  diploma  examination.  A set  of 
common  questions,  having  the  same 
content  and  emphasis  as  the  machine- 
scorable  component  of  the  diploma 
examination,  is  administered  yearly  to 
a sample  of  students  registered  to 
write  the  diploma  examination.  We 


refer  to  this  set  of  common  questions 
as  an  ‘anchor’  test. 

Table  6.1  presents  the  number  of 
students  who  wrote  the  anchor  tests 
each  year.  Only  students  with  current 
school-awarded  and  diploma 
examination  marks  are  included  in  the 
samples. 

The  questions  from  these  anchor  tests 
are  not  released  to  the  public  and  are 
administered  again  in  the  anchor  tests 
of  subsequent  years.  Following  the 
administration  and  scoring  of  the 
diploma  examinations,  a student’s 
anchor  test  mark  is  matched  with  his 
or  her  machine-scored  mark  on  a 
diploma  examination. 

Results  from  the  anchor  tests  are 
compared  between  yearly 
administrations  and  are  used  to 
compare  achievement  on  the  machine- 
scorable  components  of  the  respective 
examinations. 

In  Enghsh,  only  the  reading 
component,  which  is  50%  of  the 
student’s  examination  mark,  is 
compared  using  this  method.  A 
qualitative  study.  Patterns  and 
Processes:  Approaches  to  Writing  by 
Grade  12  Students  (1990),  reviewed 


student  written  work  in  English  30, 
Social  Studies  30,  and  English  33. 

During  the  first  year  of  the 
Achievement-Over-Time  Studies, 

1989,  anchor  tests  were  administered 
in  English  30,  Enghsh  33,  and  Social 
Studies  30.  Anchor  tests  were  not 
administered  in  Mathematics  30, 
Biology  30,  Chemistry  30,  and 
Physics  30  until  June  1990. 

For  Mathematics  30,  no  comparisons 
are  made  to  results  for  1991  or  earlier 
because  of  changes  made  to  the 
curriculum  in  1991. 

Equating  Procedure 

To  place  the  results  of  different  tests 
on  the  same  scale,  all  scores  are 
expressed  in  terms  of  the  results  from 
a baseline  year.  The  basehne  year  is 
1992.  A statistical  procedure  called 
hnear  equating  is  used  to  equate  the 
results  from  each  diploma  examination 
to  the  basehne. 

The  statistical  procedure  uses  the 
anchor  tests  and  takes  into 
consideration  the  peculiarities  of  each 
sample,  such  as  differing  anchor  test 
sample  size  and  differing  anchor  test 


Table  6-1 

Number  of  Students  Writing  the  Anchor  Tests 


Course 

1989 

1990 

1991 

1992 

1993 

1994 

English  30 

360 

319 

297 

352 

364 

207 

English  33 

264 

298 

249 

114 

305 

146 

Social  Studies  30 

634 

464 

303 

378 

327 

238 

Biology  30 

N/A 

405 

286 

499 

353 

305 

Chemistry  30 

N/A 

160 

291 

327 

300 

229 

Physics  30 

N/A 

74 

N/A 

224 

228 

104 

Mathematics  30 

N/A 

N/A 

N/A 

444 

272 

228 

N/A  — not  applicable  in  this  year.  No  anchor  test  was  administered. 
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sample  abilities.  The  equating 
procedure  allows  for  the  expression  of 
students’  scores  as  if  the  students  had 
written  the  diploma  examination  in  the 
baseline  year.  That  is,  by  applying  the 
formula  derived  for  English  30  to  the 
mark  of  a student  who  wrote  the  June 
1994  English  30  Diploma 
Examination,  it  is  possible  to  estimate 
the  mark  the  student  would  have 
received  if  that  student  had  written  the 
June  1992  examination. 

For  Physics  30,  only  the  multiple- 
choice  component  of  diploma 
examinations  was  used  to  equate  1990 
results  to  1992. 

Results 

Table  6-2  shows  the  mean  percentage 
scores  equated  to  the  1 992  scores  for 
the  machine-scored  component  of  the 
diploma  examinations.  These  scores 
can  be  used  to  compare  the  provincial 
achievement  of  each  year  with  that  of 
the  baseline  year.  Differences  were 


considered  significant  when  the 
probability  due  to  chance  is  equal  to  or 
less  than  1%  (p  = 0.001). 

Has  achievement,  as  measured  by 
the  diploma  examinations,  changed 
over  the  past  few  years? 

• In  English  30,  there  is  no  significant 
change  in  the  level  of  student 
achievement  on  the  machine-scored 
component  of  the  diploma 
examination  since  1989. 

• In  English  33,  the  level  of 
achievement  on  the  machine-scored 
component  of  the  diploma 
examination  is  slightly  higher  than  in 
previous  years  and  is  significantly 
higher  than  1991. 

• In  Social  Studies  30,  the  results  for 
1994  are  significantly  higher  than  the 
1989  results  only.  The  1993  Social 
Studies  30  results  were  significantly 
better  than  the  results  obtained  in 
1989,  1990,  and  1992  but  were  not 


statistically  different  from  results 
obtained  by  students  in  1991  or 
1994. 

• In  Biology  30,  the  1994  student 
achievement  is  significantly  better 
than  results  obtained  in  1991  through 

1993  but  is  not  statistically  different 
from  the  1990  results. 

• In  Chemistry  30,  the  results  for 

1994  are  significantly  lower  than  the 
1992  results  but  are  not  statistically 
different  from  the  results  for  1990, 
1991,  and  1993. 

• In  Physics  30,  results  for  1994  were 
found  to  be  significantly  lower  than 
results  for  1992  and  1993. 

• In  Mathematics  30,  student 
achievement  for  1994  is  significantly 
improved  compared  with  both  1 992 
and  1993.  The  1993  results  were 
also  significantly  better  than  results 
obtained  in  1992. 


Table  6-2 


Equated  Average  Percentage  on  the  Machine-Scored 
Component  of  the  Diploma  Examinations 


Course 

1989 

1990 

1991 

1992' 

1993 

1994 

English  30 

68.5 

68.1 

68.2 

67.5 

69.3 

69.4 

English  33 

64.2 

64.7 

63.7 

64.2 

64.8 

61.V 

Social  Studies  30 

63.8 

64.4 

66.4 

65.4 

68.2^ 

66.3^ 

Biology  30 

N/A‘'> 

67.1 

65.7 

66.6 

65.6 

69.6® 

Chemistry  30 

N/A’” 

68.7 

65.4 

67.5 

66.7 

65.5^ 

Physics  30 

N/A” 

70.9 

N/A‘° 

70.5 

68.9 

60.5' 

Mathematics  30 

N/A‘’ 

N/A‘° 

N/A”’ 

62.0 

65.3^ 

70.0’ 

^ Baseline  year:  actual  percentage  on  machine-scored  component  of  diploma  examination. 
^Equated  mean  is  significantly  larger  than  means  for  1989,  1990,  and  1992. 

^Equated  mean  is  significantly  larger  than  mean  for  1992. 

'‘Equated  mean  is  significantly  larger  than  mean  for  1991. 

^Equated  mean  is  significantly  larger  than  mean  for  1989. 

® Equated  mean  is  significantly  larger  than  means  for  1991,  1992,  and  1993. 

^Equated  mean  is  significantly  smaller  than  mean  for  1992. 

* Equated  mean  is  significantly  smaller  than  means  for  1992  and  1993. 

’Equated  mean  is  significantly  larger  than  means  for  1992  and  1993. 

”N/A  indicates  that  the  anchor  tests  were  not  administered  or  not  applicable. 
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Section  7 

Examiners* Annual  Summary  Statements 


This  section  of  the  report  describes 
how  well  students  met  performance 
standards  in  the  eight  diploma 
examination  courses.  Each  summary 
statement  addresses  three  questions: 

• What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 


• What  is  the  overall  performance  of 
students  on  the  examinations? 

• Do  the  population  and  performance 
data  reveal  any  significant  trends? 

Consistent  with  most  of  the  data 
presented  in  sections  3 through  6,  the 
data  in  this  section  of  the  report  are 


based  only  on  the  results  of  students 
who  had  both  diploma  examination 
and  school-awarded  marks. 

Consequently,  the  figures  provided 
here  are  slightly  different  from  the 
figures  on  pages  3 and  4,  which 
describe  a broader  population. 


What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

In  1993-94,  24  494  students  with 
corresponding  school-awarded  marks 
wrote  the  English  30  diploma 
examinations.  This  number, 
representing  approximately  69%  of  all 
students  writing  English  Diploma 
examinations  in  1993-94,  has 
increased  by  only  5 students  since 
1992-93. 

English  30  is  a course  “appropriate  for 
students  intending  to  pursue  further 
academic  studies”  (Senior  High  School 
Language  Arts  1982  Curriculum 
Guide,  page  6).  Participation  data 
suggest  that  a high  proportion  of 
students  expecting  to  graduate  are 
attempting  to  keep  their  options  open 
with  regard  to  future  academic  study 
by  enrolling  in  English  30. 

The  English  30  population  comprises 
more  females  than  males.  About  55% 
of  students  writing  the  English  30 
Diploma  Examination  are  female;  45% 
are  male. 

In  the  last  three  years,  about  10%  of 
those  writing  English  30  were  atypical 
in  that  they  were  either  repeating 
English  30  or  challenging  English  30 
(refer  to  Table  7-2).  Special  studies 
have  shown  that  students  who  rewrite 
English  30  usually  do  not  improve  their 
marks,  while  students  who  rewrite 
courses  other  than  English  score 


English  30 


Figure  7-1 

English  30 

Distribution  of  Diploma  Examination  Marks 
1993-94  School  Year 


Students  achieving  the  acceptable  standard 
but  not  the  standard  of  excellence. 


i::|||  Students  achieving  the 
standard  of  excellence. 


average  mark  increases  of  5 to  10%. 
Students  who  choose  to  challenge  the 
examination  without  classroom 
instruction  usually  pass  the 
examination  but  often  do  not  achieve 
marks  high  enough  to  gain  entrance  to 
further  academic  studies. 

What  is  the  overall  performance  of 
students  on  the  examinations? 

The  overall  performance  of  students 
writing  the  English  30  diploma 
examinations  during  1993-94  was 
similar  to  that  in  previous  years. 


However,  in  comparison  to  1991-92, 
a slightly  higher  proportion  of  students 
achieved  diploma  examination  marks  at 
or  above  the  standard  of  excellence. 
Consistency  of  performance  is  reflected 
in  achievement-over-time  studies 
conducted  over  the  past  three  years  (see 
Section  6). 

In  1993-94,  a significant  proportion  of 
the  students  writing  English  30  (87.2%) 
attained  diploma  examination  marks  at 
or  above  the  acceptable  standard,  and 
10.4%  attained  diploma  examination 
marks  at  or  above  the  standard  of 
excellence  (see  Figure  7-1).  Although 
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12.8%  did  not  meet  the  acceptable 
standard,  most  of  these  students 
(10.4%  of  all  students)  attained  marks 
ranging  from  40%  to  49%.  Some  of 
these  students  might  achieve  the 
acceptable  standard  if  they  receive 
further  instruction. 

Acceptable  Standard 

Students  who  achieved  at  or  slightly 
above  the  acceptable  standard  were 
able  to  understand  the  reading 
selection  presented  in  Part  A:  Written 
Response  and  to  respond  appropriately 
by  relating  details  from  the  selection 
to  their  own  experiences  when  writing 
their  response  to  the  Minor 
Assignment. 


In  responding  to  the  Major 
Assignment,  students  achieving  at  or 
slightly  above  the  acceptable  standard 
presented  a clear  controlling  idea  that 
reflected  a basic  understanding  of  the 
chosen  literary  work,  but  not  always  an 
understanding  of  the  author’s  purpose 
or  the  wider  implications  of  the 
literature.  That  is,  students  located  a 
character  or  characters  who  illustrated 
a quality  suggested  by  the  topic,  but 
they  usually  did  not  explore  what  the 
author  was  saying  through  that 
character. 

Students  achieving  at  or  slightly  above 
the  acceptable  standard  organized  their 
writing  in  a mechanical  or  functional 


way,  giving  clear  direction  to  the 
reader.  Occasionally,  however,  these 
students  simply  recounted  parts  of  the 
story.  Students  writing  at  this  level 
usually  used  language  in  a correct, 
practical  way  to  “get  the  job  done” 
rather  than  to  enhance  the  details  that 
they  were  communicating  or  to 
illustrate  ideas  for  the  reader. 

As  in  the  past,  students  at  this  level 
continued  to  demonstrate  some 
awareness  of  control  of  the  stylistic 
choices  and  the  conventions  of  written 
language.  While  such  problems  as 
pronoun-antecedent  agreement  and 
subject-verb  agreement  did  appear  in 
the  writing,  more  pervasive  and 


Table  7-1 

English  30  Diploma  Examination 
Five-Year  Comparison  by  Population  Percent  and  Achievement  Averages 


Type  of  Studen 


Year 

Subgroup 

Grade  11 
Students 

Grade  12 
Students 

Atypical 
Exam  Writers* 

Transferred 
in  From 
Outside  the 
Province 

1993-94 

Percent  of  Population 

1.5 

83.4 

10.0 

5.1 

Examination  Average 

60.4 

63.7 

58.7 

58.8 

1992-93 

Percent  of  Population 

1.7 

82.7 

10.1 

5.4 

Examination  Average 

60.8 

63.5 

58.5 

58.5 

1991-92 

Percent  of  Population 

1.6 

82.8 

9.7 

5.9 

Examination  Average 

61.9 

64.3 

59.2 

59.9 

1990-91 

Percent  of  Population 

1.3 

81.1 

9.1 

5.9 

Examination  Average 

60.4 

62.9 

59.3 

60.5 

1989-90 

Percent  of  Population 

1.8 

83.9 

8.8 

5.4 

Examination  Average 

62.7 

65.1 

60.5 

62.1 

*This  group  includes  repeaters,  individuals  challenging  the  examinations,  and  students  without  a school-awarded  mark. 


Table  7-2 

English  30 

Four-Year  Comparison  of  Selected  Population  and  Achievement  Indicators 


1990-91 

1991-92 

1992-93 

1993-94 

Number  of  Students  with  a School- Awarded  Mark 

22  841 

24  027 

24  489 

24  494 

Male/Female  Proportions  (%) 

45/55 

45/55 

45/55 

45/55 

Students  Achieving  Acceptable  Standard 
on  Diploma  Exam  (%) 

90.6 

89.0 

87.9 

87.2 

Students  Achieving  Standard  of  Excellence 
on  Diploma  Exam(%) 

9.39 

10.9 

9.6 

10.4 
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serious  were  errors  involving  word 
usage  and  confusion  of  syntax. 
However,  the  fact  that  students  with 
final  course  marks  in  the  mid-range 
(60%  to  70%)  can  and  do  produce 
some  well-written  sentences  suggests 
that  they  have  the  potential  to  move 
from  “acceptable”  to  “proficient”  in 
their  writing. 

In  responding  to  Part  B:  Reading, 
students  who  achieved  at  or  slightly 
above  the  acceptable  standard 
demonstrated  that  they  were  generally 
capable  of  effective  close  reading  and 
of  understanding  difficult  material, 
especially  non-fiction.  These  students 
were  often  unsuccessful,  however,  on 
vocabulary  and  other  complex 
questions  requiring  closer 
examination,  recognition  of  contextual 
clues,  and  re-reading  of  the  passage. 

Standard  of  Excellence 

Students  who  achieved  the  standard  of 
excellence  on  Part  A:  Written 


What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

In  1993-94,  11  020  students  with 
corresponding  school-awarded  marks 
wrote  English  33  diploma 
examinations.  This  is  approximately 
32%  of  all  such  students  who  wrote 
English  30  or  Enghsh  33  diploma 
examinations  in  1993-94.  Generally, 
students  who  write  Enghsh  33  write 
few  (if  any)  other  diploma 
examinations  (see  Figure  2-3). 

English  33  is  a course  “appropriate  for 
students  intending  to  go  to  vocational 
school  or  to  seek  employment  after 
leaving  high  school”  (Senior  High 
School  Language  Arts  1982 
Curriculum  Guide,  page  6).  The  fact 
that  so  few  English  33  students  took 
other  diploma  examination  courses 
may  indicate  that  these  students  did, 
indeed,  plan  to  enter  the  workforce 
immediately  upon  graduation. 

In  1993-94,  as  in  previous  years, 
English  33  was  selected  by  more  male 
students  than  female  students  (see 
Figure  3-1).  Also,  as  can  be  seen  in 


Response  produced  writing  that 
displayed  confidence  in  ideas, 
organization,  and  choice  of  language. 
Writing  at  this  level  reflected  a 
sensitivity  to  the  emotional  tone  of  the 
reading  selection  and  also  reflected  an 
appreciation  of  the  importance  of 
lively,  concrete  detail  in  personal 
responses.  Often,  there  was  a mature 
understanding  of  the  significance  of 
the  topic  in  the  greater  scope  of  human 
endeavor. 

In  responding  to  the  Major 
Assignment,  students  at  this  level  of 
achievement  demonstrated  a 
perceptive  understanding  of  literature. 
They  were  able  to  use  the  topic  as  a 
springboard  to  a focused,  engaging, 
thorough  examination  of  a chosen 
work  of  literature.  Students  who 
achieved  the  standard  of  excellence 
were  confident  but  thoughtful  in 
presenting  their  ideas  and  opinions. 
Their  ability  to  use  language 
effectively  to  enhance  their  expression 
also  suggested  confidence. 


English  33 

Table  7-3,  atypical  examination 
writers  formed  13.5%  of  the  total 
number  of  individuals  who  wrote 
English  33  diploma  examinations  in 
1993-94  (A=  11  976).  This 
proportion  is  much  higher  than  that  for 
other  diploma  examinations  (for 
example,  6. 1 % in  Social  Studies  30) 
and  suggests  that  many  individuals 
who  are  writing  English  33  diploma 
examinations  are  challenging  the 
examination  or  are  repeating.  The 
overall  achievement  of  atypical 
examination  writers  is  higher  than  is 
the  overall  achievement  for  other 
groups  shown  in  Table  7-3.  Again, 
this  is  unusual  for  diploma 
examination  courses  in  that  the  overall 
achievement  of  similar  groups  of 
atypical  examination  writers  in  other 
courses  is,  without  exception,  lower 
than  for  the  other  groups  shown  in  the 
tables.  (See  Tables  7-1,  7-3,  7-5,  7-7, 
and  7-10.) 


What  is  the  overall  performance  of 
students  on  the  examinations? 

The  overall  performance  of  the  1 1 020 
students  with  corresponding  school- 


In  responding  to  Part  B:  Reading, 
students  achieving  the  standard  of 
excellence  demonstrated  that  they  had 
highly  developed  skills  in  close 
reading.  These  students  also  achieved 
noticeably  higher  scores  on  questions 
requiring  competence  in  vocabulary. 
Students  at  this  level  were  successful 
at  reading  critically  and  responding 
precisely  to  complex  literary  works 
such  as  Shakespearean  drama  and 
poetry  dense  with  imagery. 

Do  the  population  and  performance 
data  reveal  any  signiHcant  trends? 

Table  7-2  provides  a comparison 
over  the  last  five  years  of  selected 
population  and  performance 
indicators.  The  significant  increase 
between  1990-91  and  1992-93  of 
students  writing  the  diploma 
examination  in  English  30  did  not 
continue  in  the  year  1993-94,  only 
five  students  having  been  added. 


awarded  marks  who  wrote  the  English 
33  diploma  examinations  this  past 
school  year  was  generally  satisfactory. 
In  1993-94,  85.0%  of  students  writing 
Enghsh  33  attained  diploma 
examination  marks  at  or  above  the 
acceptable  standard,  and  5.1% 
attained  diploma  examination  marks  at 
or  above  the  standard  of  excellence 
(see  Figure  7-2).  The  proportion  of 
students  who  did  not  meet  the 
acceptable  standard  was  15.0%,  but 
1 1 .6%  of  students  attained  marks 
ranging  from  40%  to  49%.  Only  3.4% 
attained  marks  of  39%  or  lower. 

Increase  in  Standards  for  Matters  of 
Convention 

In  1992-93,  additions  were  made  to 
two  of  the  criteria  under  the  Matters  of 
Convention  scoring  category  for 
Section  I:  Personal  Response  to 
Literature.  These  additions  are  given 
in  last  year’s  Annual  Report. 

Similar  additions  were  made  in  1992- 
93  to  the  Writing  Skills  scoring 
descriptors  for  Section  II:  Functional 
Writing  and  Section  III:  Response  to 
Visual  Communication. 
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In  1993-94,  further  revisions  were 
made  to  the  scoring  criteria  under  the 
Matters  of  Correctness*  and  Writing 
Skills  scoring  categories.  During  the 
marking  of  the  English  diploma 
examinations  in  1994,  the  scoring 
criteria  under  Matters  of  Correctness 
for  English  30  and  English  33  were 
exactly  the  same. 

It  is  important  to  note  that  these 
additions  and  revisions  constitute  a 
raising  of  the  standards  for  Matters  of 
Correctness.  Beginning  in  January 
1993  and  again  in  January  1994,  there 
was  an  increased  expectation  for 
degree  of  correctness  in  language  use 
for  students  writing  the  English  33 
diploma  examinations. 

Acceptable  Standard 

Students  who  achieved  at  or  slightly 
above  the  acceptable  standard  were 
able  to  respond  clearly  and  correctly 
to  all  three  assignments  in  Part  A: 
Written  Response.  They  demonstrated 
a clear  understanding  of  the  reading 
selection  in  their  responses  to  Section 
I:  Personal  Response  to  Literature,  and 
they  addressed  the  assignment  in  a 
conventional  manner.  These  students 
discussed  life  experiences  and  themes 
from  literature  in  perfunctory  but 
acceptable  ways. 

*In  1993-94  the  scoring  category  Matters  of 
Convention  was  renamed  Matters  of  Correctness 
to  signal  to  students  that  correctness  of  expression 
is  important. 


Students  achieving  at  or  slightly  above 
the  acceptable  standard  provided 
satisfactory  responses  to  Section  II: 
Functional  Writing.  These  students  used 
the  information  provided  in  the 
assignment  to  fulfill  their  purposes 
sufficiently  and  were  able  to  adopt  an 
appropriate  tone  that  demonstrated  an 
awareness  of  audience.  They  were  able 
to  organize  their  work  logically  and 
clearly. 

When  responding  to  Section  III: 
Response  to  Visual  Communication, 
these  students  tended  to  interpret  the 
photograph  in  conventional  ways 
using  generalized  observations  for 
support.  Students  who  just  met  the 
acceptable  standard  on  Part  A: 

Written  Response  provided  few 
specific  details  in  their  writing. 

Writing  skills  demonstrated  by  these 
students  were  minimally  acceptable. 

In  responding  to  Part  B:  Reading, 
students  who  achieved  at  or  slightly 
above  the  acceptable  standard  were 
able  to  understand  reading  selections 
that  were  intended  for  a general 
audience.  They  were  able  to  draw 
some  inferences  from  context  and  to 
apply  basic  concepts  such  as  metaphor 
and  foreshadowing.  However,  these 
students  had  difficulty  understanding 
and  interpreting  irony  and  other  tonal 
qualities. 

In  responding  to  the  revision 
assignments  on  Part  B:  Reading 


Figure  7-2 

English  33 

Distribution  of  Diploma  Examination  Marks 
1993-94  School  Year 


Students  achieving  the  acceptable  standard 
but  not  the  standard  of  excellence. 


■ Students  achieving  the 
standard  of  excellence. 


(students  were  required  to  make 
decisions  about  appropriate  revisions 
to  the  draft  of  a letter),  many  students 
achieving  at  or  slightly  above  the 
acceptable  standard  appeared  to 
understand  the  rationale  behind 
revisions  in  areas  such  as  syntax, 
diction,  and  conventions.  What  was 
discouraging  was  that  many  of  these 
students  did  not  transfer  this  apparent 
understanding  to  their  own  writing  on 
Part  A:  Written  Response. 

Standard  of  Excellence 

Students  who  achieved  the  standard  of 
excellence  generally  produced  work  of 
superior  quality  on  all  of  the  assignments 
in  Part  A:  Written  Response.  When 
responding  to  Section  I:  Personal 
Response  to  Literature,  students  at  this 
level  usually  interpreted  the 
assignment  in  an  insightful  way.  They 
presented  significant  themes  or  ideas 
and  used  precise  examples  from  life 
and  literature  to  support  their  themes. 
Many  of  these  students  responded  to 
the  universal  implications  of  the 
selections  and  explored  topics  in  a 
perceptive  manner.  These  students 
used  precise,  thoughtfully  chosen,  and 
often  imaginative  details.  They  were 
able  to  select  examples  and 
illustrations  from  reading  selections, 
from  their  own  experience,  and  from 
other  literature  to  fulfill  their  purpose. 
Their  writing  was  focused,  coherent, 
and  smoothly  developed.  They  used 
words  and  structures  that  were 
effective  and  basically  free  from 
errors.  These  students  projected 
confidence  in  their  writing. 

When  responding  to  Section  II: 
Functional  Writing,  students  achieving 
the  standard  of  excellence  used  an 
appropriate  and  engaging  tone.  They 
provided  significant  information  that 
was  enhanced  by  appropriate  details. 
These  students  had  a precise 
awareness  of  audience,  and  they 
provided  important  and  essential 
information  necessary  for  their 
purpose.  Writing  skills  demonstrated 
at  this  level  were  relatively  even;  word 
choice  and  sentence  structure  were 
appropriate  and  often  effective,  and 
there  were  few  errors  in  mechanics 
and  grammar. 
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When  responding  to  Section  III: 
Response  to  Visual  Communication, 
students  achieving  the  standard  of 
excellence  presented  insightful 
interpretations  of  the  photograph, 
stating  appropriate  themes  or  ideas. 
Their  ideas  were  typically  extended 
and  reinforced  throughout  their 
compositions.  These  students  chose 
specific  elements  from  the  photograph 
to  support  their  ideas.  They  made  few 
mechanical  or  grammatical  errors  and 
produced  relatively  lengthy  responses. 

When  responding  to  Part  B:  Reading, 
students  achieving  the  standard  of 
excellence  demonstrated  an 
understanding  of  relatively 
complicated  literature.  They  were 
able  to  delve  beyond  the  literal  level 
of  a work  to  make  inferences  from 
important  features  such  as  irony  and 
symbolism.  These  students 


demonstrated  that  they  carefully  and 
thoughtfully  read  the  selections  and  all 
parts  of  each  question  before 
answering. 

Do  the  population  and  performance 
data  reveal  any  significant  trends? 

Table  7-4  provides  a comparison  over 
the  last  four  school  years  of  selected 
population  and  performance  indicators. 
The  number  of  students  writing 
English  33  diploma  examinations 
continues  to  increase  each  year.  The 
increase  between  1990-91  and  1993- 
94  is  28.3%,  and  the  increase  since 
last  year  is  10.9%. 

The  proportion  of  male  and  female 
students  writing  the  Enghsh  33 
diploma  examinations  has  remained 
relatively  constant  over  the  past  four 


years,  but  this  difference  in  proportion 
is  unusual  for  diploma  examination 
subjects  (see  Figure  3-1). 

The  two  performance  indicators  have 
declined  over  the  past  three  school 
years.  The  difference  in  the  proportion 
of  students  achieving  either  standard 
from  year  to  year  is  slight,  but  appears 
to  indicate  a downward  trend. 
However,  given  that  writing  standards 
were  increased  for  English  33  in 
1992-93,  and  again  in  1993-94,  this 
apparent  dechne  can  be  attributed  to 
an  increase  in  standards  rather  than  a 
decrease  in  achievement.  Additional 
evidence  to  support  this  conclusion 
can  be  found  in  Table  6-2;  results  of 
the  English  33  achievement-over-time 
study  suggests  that  students  writing 
Part  B of  the  June  1994  English  33 
Diploma  Examination  outperformed 
students  from  other  years. 


Table  7-3 

English  33  Diploma  Examination 
Five-Year  Comparison  by  Population  Percent  and  Achievement  Averages 


Year 

Subgroup 

Grade  11 
Students 

Grade  12 
Students 

Atypical 
Exam  Writers* 

Transferred 
in  From 
Outside  the 
Province 

1993-94 

Percent  of  Population 

4.8 

77.4 

13.5 

4.3 

(N=U  976) 

Examination  Average 

61.4 

61.1 

62.9 

59.7 

1992-93 

Percent  of  Population 

5.1 

77.4 

12.6 

4.9 

Examination  Average 

60.8 

61.9 

63.6 

60.0 

1991-92 

Percent  of  Population 

4.5 

78.2 

12.5 

4.8 

Examination  Average 

62.9 

62.2 

64.5 

60.3 

1990-91 

Percent  of  Population 

3.0 

81.1 

11.2 

4.7 

Examination  Average 

61.9 

62.9 

64.1 

59.9 

1989-90 

Percent  of  Population 

3.1 

82.1 

9.9 

4.9 

Examination  Average 

61.9 

61.3 

63.4 

60.9 

*This  group  includes  repeaters,  individuals  challenging  the  examinations,  and  students  without  a school-awarded  mark. 


Table  7-4 

English  33 

Four- Year  Comparison  of  Selected 
Population  and  Achievement  Indicators 


1990-91 

1991-92 

1992-93 

1993-94 

Number  of  Students  with  a School-Awarded  Mark 

8 586 

9 254 

9 939 

11  020 

Male/Female  Proportions  (%) 

57/43 

58/42 

58/42 

56/44 

Students  Achieving  Acceptable  Standard 
on  Diploma  Exam  (%) 

88.5 

87.3 

86.2 

85.0 

Students  Achieving  Standard  of  Excellence 
on  Diploma  Exam(%) 

5.9 

5.5 

5.5 

5.1 

30 


Social  Studies  30 


What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

In  1993-94,  21  351  students  with 
corresponding  school-awarded  marks 
wrote  the  Social  Studies  30  diploma 
examinations.  Generally,  students 
writing  Social  Studies  30  also  wrote 
other  diploma  examinations.  (See 
Figure  2-3.)  There  is  also  a high 
correlation  (0.76)  between  Social 
Studies  school-awarded  marks  and 
Social  Studies  30  diploma  examination 
marks.  (Sec  Tabic  2- 1 .) 

Social  Studies  30  is  a course  “designed 
for  those  students  ho  arc  seeking  an 
Advanced  High  School  Diploma  and 
who  will  likcl)  pursue  post -secondary 
studies”  (Senior  Hii;h  S<h  lal  Studies 
Program  of  Studies.  .Mas  1993,  page  1). 
The  fact  that  man>  Social  Studies  30 
students  took  other  diploma 
examination  courses  ma>  indicate  that 
these  students  general l>  plan  to  enter 
post-secondary  institutions  upon 
graduation. 

Social  Studies  30  was  selected  by  more 
female  than  male  students.  In  1993-94, 

1 1 261  female  students  and  10  090  male 
students  wrote  the  Social  Studies  30 
diploma  examinations.  Also,  as  can  be 
seen  in  Table  7-5,  the  size  of  subgroup 
populations  and  their  success  on  the 
Social  Studies  30  diploma  examinations 
have  been  relatively  consistent  over  the 
years.  The  group  of  atypical 
examination  writers  has,  however, 
tended  to  perform  below  that  of  the 
other  population  subgroups. 

What  is  the  overall  performance  of 
students  on  the  examinations? 

The  overall  performance  of  the  21  351 
students  with  corresponding  school- 
awarded  marks  who  wrote  the  Social 
Studies  30  diploma  examinations  was 
generally  satisfactory.  In  1993-94, 
83.6%  of  the  students  writing  Social 
Studies  30  attained  diploma 
examination  marks  at  or  above  the 
acceptable  standard,  and  14.5%  of  the 
students  attained  diploma  examination 
marks  at  or  above  the  standard  of 
excellence  (see  Figure  7-3).  The 
proportion  of  students  who  did  not 
achieve  the  acceptable  standard  was 
16.3%,  but  12.3%  of  students  attained 


marks  ranging  from  40%  to  49%.  The 
percentage  of  students  whose  marks 
were  39%  or  lower  was  3.9%. 

Acceptable  Standard 

In  answering  the  multiple-choice 
questions  in  Part  A of  the  examination, 
students  who  achieved  at  or  slightly 
above  the  acceptable  standard  were 
able  to  recall  and  comprehend  certain 
historical  events  or  economic  and 
political  concepts.  Students  just  meeting 
the  acceptable  standard  experienced 
difficulty,  however,  with  questions 
involving  chronology,  various  critical 
thinking  skills,  and  the  application  of 
knowledge  to  new  or  unfamiliar 
situations.  In  particular,  these  students 
experienced  difficulty  with  textual  or 
data-based  questions  (such  as  those 
involving  a cartoon,  graph,  map,  or 
series  of  quotations)  that  required  them 
to  see  relationships,  interpret  trends, 
understand  cause  and  effect,  or  identify 
stated  or  unstated  assumptions. 

Many  students  who  just  met  the 
acceptable  standard  had  difficulty 
dealing  with  the  complexity  of  the  task 
on  Part  B:  Written  Response.  Typically, 
these  students  presented  largely 
descriptive  essays  containing  both 
relevant  and  irrelevant  detail.  Many 
students  who  just  met  or  who  fell  short 
of  the  acceptable  standard  had  difficulty 
applying  and  integrating  concepts  and 
defining  the  issues.  They  appear  to  have 


rushed  headlong  into  their  writing 
without  planning  their  essays  and 
without  considering  the  relevance  of 
historical  or  contemporary  examples 
associated  with  the  issues  under 
discussion. 

Students  who  fell  short  of  the 
acceptable  standard  often  presented 
memorized  information  at  random, 
rather  than  a thought-out  discussion. 
They  left  the  task  of  sorting  out 
scattered  facts  to  the  reader.  They 
presented  popularly  accepted  versions 
of  past  or  present  events  as 
unsupported,  simple  assertions.  They 
often  made  little  attempt  to  elaborate, 
explain,  or  develop  ideas.  Such 
writing  received  low  scores. 

Standard  of  Excellence 

In  answering  the  multiple-choice 
questions  in  Part  A,  students 
achieving  the  standard  of  excellence 
demonstrated  that  they  understood 
social  studies  concepts  and 
comprehended  historical,  political, 
and  economic  relationships,  many  of 
which  are  very  complex.  They  were 
consistently  able  to  interpret  and 
evaluate  information  and  ideas,  and  to 
review,  analyze,  and  synthesize 
specific  information. 

Students  who  achieved  the  standard 
of  excellence  often  produced  powerful 
and  substantive  writing  in  their 
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Figure  7-3 
Social  Studies  30 

Distribution  of  Diploma  Examination  Marks 
1993-94  School  Year 
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but  not  the  standard  of  excellence. 
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B Students  achieving  the 
standard  of  excellence. 


responses  to  the  assignment  in  Part  B: 
Written  Response.  Given  the 
complexity  of  the  task  and  the 
constraints  of  time,  some  of  these 
students’  compositions  were  truly 
remarkable.  Many  of  the  responses  of 
students  achieving  at  this  level 
revealed  qualities  of  argument, 
support,  development,  and 
organization  that  exhibited  a breadth 
of  historical  and  contemporary 
knowledge.  Students  achieving  the 
standard  of  excellence  clearly  showed 
ownership  of  the  ideas  they  expressed; 
their  writing  revealed  engaged  minds 
thoughtfully  immersed  in  issues 
relevant  and  meaningful  to  them. 
These  students  were  comfortable  in 
exploring  ideas  in  their  complexity. 

Do  the  population  and  performance 
data  reveal  any  significant  trends? 


Table  7-6  provides  a comparison  over 
the  last  four  school  years  of  selected 
population  and  performance  indicators. 

The  number  of  students  writing  Social 
Studies  30  diploma  examinations 
continues  to  increase.  Since  1990-91, 
the  increase  has  been  5.9%.  The 
proportion  of  male  and  female 
students  writing  and  the  two 
performance  indicators  have  remained 
relatively  constant  (see  Table  7-6). 

Although  more  females  than  males 
wrote  the  diploma  examination  in 
Social  Studies,  males  continued  to 
achieve  higher  averages  than  females: 
66.3%  compared  with  64.2%  in  1992- 
93,  and  65.8%  compared  with  62.0% 
in  1993-94.  On  the  multiple-choice 
component,  in  particular,  males 
consistently  achieve  higher  scores 
than  females  (70.3%  compared  with 
64.7%  in  1993-94).  This  difference  is 


not  evident  in  the  written  response, 
where  the  averages  in  1993-94  were 
55.3%  for  males  and  55.4%  for  females. 

Student  performance  on  the  Social 
Studies  30  Diploma  Examination  is 
showing  some  improvement  over 
performance  in  previous  years.  For 
1994,  students  performed  better  on  the 
machine-scored  component  of  the 
examination  than  in  previous  years.  The 
proportions  of  students  achieving  the 
standards  remain  relatively  constant. 
Revisions  to  the  examination  blueprint, 
beginning  in  1990,  have  emphasized  the 
demonstration  of  cognitively  demanding 
critical-thinking  skills  in  both  the 
multiple-choice  and  written  components 
of  the  examination.  Given  that  standards 
have  increased,  it  is  encouraging  that  the 
proportions  of  students  achieving 
standards  (whose  numbers  have  also 
increased)  have  remained  relatively 
consistent  over  the  years. 


Table  7-5 


Social  Studies  30  Diploma  Examination 
Five-Year  Comparison  by  Population  Percent  and  Achievement  Averages 


Year 

Subgroup 

Grade  1 1 
Students 

Grade  12 
Students 

Atypical 
Exam  Writers* 

Transferred 
in  From 
Outside  the 
Province 

1993-94 

Percent  of  Population 

2.3 

87.1 

6.1 

4.5 

(AT  =22  137) 

Examination  Average 

63.6 

63.6 

57.2 

62.3 

1992-93 

Percent  of  Population 

1.8 

88.0 

5.7 

4.4 

Examination  Average 

60.5 

62.1 

60.0 

61.1 

1991-92 

Percent  of  Population 

2.1 

87.5 

5.4 

5.0 

Examination  Average 

60.5 

62.6 

55.8 

61.3 

1990-91 

Percent  of  Population 

1.2 

89.4 

4.3 

5.1 

Examination  Average 

61.6 

64.4 

58.4 

63.3 

1989-90 

Percent  of  Population 

1.4 

89.3 

4.6 

4.7 

Examination  Average 

58.8 

62.5 

56.9 

62.2 

*This  group  includes  repeaters,  individuals  challenging  the  examination,  and  students  without  a school-awarded  mark. 


Table  7-6 

Social  Studies  30 

Four- Year  Comparison  of  Selected 
Population  and  Achievement  Indicators 


1990-91 

1991-92 

1992-93 

1993-94 

Number  of  Students  with  a School-Awarded  Mark 

20  168 

20  804 

21  098 

21  351 

Male/Female  Proportions  (%) 

47/53 

47/53 

47/53 

47/53 

Students  Achieving  Acceptable  Standard 
on  Diploma  Exam  (%) 

84.2 

81.1 

79.9 

83.6 

Students  Achieving  Standard  of  Excellence 
on  Diploma  Exam  (%) 

15.9 

13.4 

12.5 

14.5 
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What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

Fran9ais  30  is  the  final  course  of  the 
Frangais  10-20-30  program  designed 
for  francophone  students  as  defined  in 
Section  23  of  the  Canadian  Charter  of 
Rights  and  Freedoms.  Students 
enrolled  in  Fran^ais  30  are  required  to 
write  the  Fran^ais  30  Diploma 
Examination. 

There  were  87  regular  school  students 
who  wrote  the  Fran9ais  30  Diploma 
Examination  in  the  1993-94  school 
year,  12  of  whom  completed  the  course 
in  the  first  semester  and  wrote  the 
January  1994  examination.  The  other 
75  were  in  full-year  programs  and 
wrote  the  examination  in  June  1994. 
Three  mature  students  challenged  the 
Fran9ais  30  examination  in  January 
1994  and  seventeen  students  from  an 
Immersion  Program  also  challenged 
the  Fran9ais  30  Diploma  examination 
in  June  1994,  for  a total  of  107  written 
examinations.  Because  very  few 
students  wrote  at  each  examination 
administration,  results  must  be 
interpreted  with  caution. 

What  is  the  overall  performance  of 
students  on  the  examinations? 

The  overall  performance  of  the  87 
regular  school  students  who  wrote  the 
Fran9ais  30  Diploma  Examination  in 
the  1993-94  school  year  was  very 
good.  All  but  two  attained  final  course 
marks  at  or  above  the  acceptable 
standard,  and  16  of  them  achieved  the 
standard  of  excellence. 

Students  enrolled  in  Fran9ais  30  wrote 
an  average  of  five  diploma 
examinations,  indicating  that  most  of 
these  students  are  hoping  to  receive  the 
Advanced  High  School  Diploma. 

More  students  achieved  the  standard 
of  excellence  in  1993-94  compared 
with  1992-93.  However,  such 
differences  are  not  generalizable 
because  of  the  small  population. 


Frangais  30 

La  Partie  A:  Production  ecrite 

The  written-response  section  of  the 
Fran9ais  30  Diploma  Examination 
required  students  to  write  two 
assignments  related  to  a selection  from 
a work  of  literature  presented  on  the 
examination.  The  first  assignment, 
“Premier  Sujet,”  elicited  a personal 
response  to  the  selection.  The  second, 
“Deuxieme  Sujet,”  asked  students  to 
select  a work  of  literature  studied  in 
their  high  school  Fran9ais  class  and  to 
relate  it  to  a given  theme  inspired  by 
the  selection  presented  on  the 
examination. 

Students  were  able  to  understand  the 
tone  and  content  of  the  given  literature 
and  to  respond  clearly  and  effectively. 
For  the  personal  response,  they 
expressed  their  opinions  and  reactions 
with  confidence.  Most  took  the  more 
obvious  approach  to  the  question  by 
supporting  the  given  theme,  and  a few 
were  able  to  present  an  opposing  view 
successfully.  Examples  taken  from 
their  own  experiences  or  from  general 
observations  were  generally 
appropriate  and  often  interesting. 
Although  the  writing  of  students  just 
meeting  the  acceptable  standard  was 
sometimes  wordy  and  repetitious, 
markers  clearly  understood  what  they 
had  to  say.  Students  achieving  the 
standard  of  excellence  were  able  to 
present  their  ideas  succinctly,  directly, 
and  emphatically. 

In  the  second  assignment,  students  had 
no  difficulty  selecting  works  that 
reflected  the  given  theme.  Students 
achieving  the  standard  of  excellence 
chose  significant  details  from  the 
literature  to  show  how  the  given 
theme  was  developed  by  the  author. 
Students  just  meeting  the  acceptable 
standard  tended  to  choose  more  minor 
details  or  to  repeat  one  significant 
detail,  with  less  effect.  All  students, 
however,  were  able  to  convince  the 
readers  of  the  relationship  between 
what  they  had  read  and  what  the 
assignment  required.  Students  have 
learned  well  how  to  organize  their 


ideas,  how  to  choose  effective 
vocabulary  and  structures,  and 
generally  how  to  follow  conventions 
of  language. 

It  must  be  remembered  that  students 
are  writing  in  a limited  time  under 
stress  and  that  their  work  is 
considered  a first  draft.  Under  these 
conditions,  what  they  achieved  was 
impressive  and  often  a pleasure  to 
read. 

La  Partie  B:  Comprehension  ecrite 

Part  B:  Reading  Comprehension 
consisted  of  two  booklets.  The 
readings  booklet  contained  selections 
from  non-fiction  and  fiction,  two 
poems,  and  one  piece  of  drama.  The 
questions  booklet  contained  70 
multiple-choice  questions  based  on 
these  readings.  The  questions  were 
classified  according  to  thinking  skills. 

Students’  performance  was  generally 
satisfactory.  They  were  able  to 
identify  and  select,  infer,  interpret, 
and  evaluate  main  ideas.  They  were 
also  able  to  recognize  the  rapport 
between  the  author  and  the  reader  as 
well  as  discern  values  expressed. 
Students  achieving  the  standard  of 
excellence  seemed  better  able  to 
discern  the  nuances  required  to 
choose  the  right  answer  in  some 
questions.  Students  achieving  the 
acceptable  standard  did  well  on  the 
questions  requiring  a literal 
understanding.  These  students  should 
be  encouraged  to  refer  to  the  reading 
selections  when  contemplating  their 
answers.  This  could  help  them  to 
perceive  more  of  the  nuances  of  the 
text. 

Do  the  population  and  performance 
data  reveal  any  significant  trends? 

We  can  make  no  comments  on  trends 
in  the  data  because  the  number  of 
students  enrolled  in  the  course  is 
extremely  small. 
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Mathematics  30 


What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

In  1993-94,  20  132  students  with 
corresponding  school-awarded  marks 
wrote  the  Mathematics  30  Diploma 
Examination.  This  represents 
approximately  51%  of  the  students  who 
wrote  either  the  English  30  or  English 
33  diploma  examinations. 

What  is  the  overall  performance  of 
students  on  the  examinations? 

There  was  no  change  in  overall 
performance  of  students  who  wrote  the 
Mathematics  30  diploma  examinations 
during  the  1993-94  school  year  over 
the  1992-93  administrations.  In  1993- 
94, 15.2%  of  the  students  wnting 
Mathematics  30  attained  diploma 
examination  marks  at  or  above  the 
acceptable  standard,  uhieh  is  the  same 
as  in  the  1992-93  school  year.  There 
was  a difference  however,  in  the 
percentage  of  students  who  achieved 
the  standard  of  excellence.  In  the 
1993-94  school  year,  16.7%  of  the 
students  achieved  the  standard  of 
excellence,  which  is  lower  than  the 
1992-93  school  year  when  17.8%  of 
students  achieved  the  standard  of 
excellence  (see  Figure  7-4).  During  the 


1993-94  administrations,  24.8%  of  the 
students  did  not  achieve  the  acceptable 
standard — the  same  as  in  1992-93. 

Standards  for  the  Mathematics  30 
diploma  examinations  for  the  1993-94 
school  year  were  published  in  the 
Mathematics  30  Diploma  Examination 
Information  Bulletin.  The  emphases  on 
problem  solving  and  communication 
skills  in  the  Mathematics  30 
curriculum  were  incorporated  into  the 
examination.  On  the  examination, 
students  were  expected  to  describe 
mathematical  situations,  explain  their 
solutions,  write  directions,  explain 
their  reasoning,  create  new  problems, 
create  new  strategies,  generalize  a 
mathematical  situation,  and  formulate 
hypotheses.  The  Mathematics  30 
examiners’  reports  outline  the  scoring 
criteria  for  these  questions. 

Acceptable  Standard 

Students  who  achieved  the  acceptable 
standard  of  performance  but  not  the 
standard  of  excellence  (58.5%)  were 
able  to  solve  problems  involving  more 
than  one  step  as  long  as  the 
information  provided  was  given  in  a 
“standard”  form  and  could  be 
referenced  on  the  formula  sheet.  In 
trigonometry,  for  instance,  students 
were  able  to  solve  a trigonometric 


identity  when  the  information  needed  to 
solve  the  identity  was  given  on  the 
formula  sheet.  For  the  most  part, 
students  in  this  group  were  able  to 
recognize  relationships  between 
mathematical  concepts  and  were  able  to 
recognize  these  relationships  as  long  as 
they  were  presented  in  a specific  sense. 
Many  were  not  able  to  identify  these 
relationships  in  the  general  case.  For 
example,  these  students  were  able  to 
find  the  zeros  of  a polynomial,  given  its 
graph,  and  then  were  able  to  identify 
that  there  is  a relationship  between  the 
multiplicities  of  the  zeros  of  the 
polynomial  and  the  degree  of  the 
polynomial,  but  they  could  not 
generalize  the  effect  on  the  graph  of  the 
polynomial  if  the  multiplicities  of  the 
zeros  changed. 

Students  who  did  not  achieve  the 
acceptable  standard  of  performance  on 
the  Mathematics  30  Diploma 
Examination  (24.8%)  had  difficulty 
solving  problems  other  than  those  that 
required  solving  for  a single  piece  of 
information  using  a formula  provided 
on  the  formula  sheet.  These  students 
were  able  to  solve  problems  that 
required  a one-step  translation,  such  as 
finding  the  value  for  sec  0,  given  cos  Q. 
As  a second  example,  these  students 
were  able  to  find  the  zeros  of  a 
polynomial,  given  its  graph,  but  were 
not  able  to  recognize  that  there  is  a 
relationship  between  the  multiphcities 
of  the  zeros  of  the  polynomial  and  the 
degree  of  the  polynomial. 

Standard  of  Excellence 

Students  who  achieved  the  standard  of 
excellence  in  Mathematics  30  (16.7%) 
had  little  difficulty  solving  any 
problems,  regardless  of  the  manner  in 
which  the  material  was  presented  and 
the  number  of  steps  required  to  solve 
the  problem.  For  instance,  students  who 
achieved  the  standard  of  excellence 
were  able  to  read  information  from 
equations  that  were  presented  in  both 
“standard”  and  “non-standard”  forms. 
Further,  they  recognized  and  were  able 
to  describe  relationships  between 
mathematical  concepts  in  both  the 
specific  and  the  general  cases.  For 
example,  these  students  were  able  to 
find  the  zeros  of  a polynomial,  given  its 
graph,  and  then  were  able  to  identify 
that  there  is  a relationship  between  the 
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Figure  7-4 

Mathematics  30 

Distribution  of  Diploma  Examination  Marks 
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multiplicities  of  the  zeros  of  the 
polynomial  and  the  degree  of  the 
polynomial.  They  could  then  discuss 
this  polynomial  in  the  general  case;  for 
instance,  how  the  graph  of  the 
polynomial  would  change  if  the 
multiplicity  of  the  zero  changed. 
Students  who  achieved  the  standard  of 
excellence  were  able  to  relate  one 
concept  to  another  and  were  able  to 
apply  concepts  in  unfamiliar  situations. 

Do  the  population  and  performance 
data  reveal  any  signiflcant  trends? 

For  the  sixth  year  in  a row, 
approximately  30%  of  the  students  who 
wrote  the  examination  in  June  did  not 
meet  the  acceptable  standard. 

Many  students  who  are  enrolled  in 
Mathematics  30  continue  to  have 
difficulty  relating  an  algebraic 
expression  to  a graphical 


What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

In  1993-94,  17  943  students  wrote  the 
Biology  30  diploma  examinations  and 
also  received  a school-awarded  mark. 
This  represents  a decrease  of  16.9% 
compared  with  1992-93.  This  decrease 
can  be  partially  accounted  for  in  that 


representation.  For  instance,  students 
may  be  able  to  solve  a trigonometric 
equation  but  cannot  relate  the  meaning 
of  the  solution  to  the  graph  of  the 
trigonometric  function. 

Communication  skills  in  mathematics 
are  improving.  Students  are  willing  to 
attempt  to  explain  mathematical 
procedures  or  concepts.  During  the 
1993-94  school  year,  students  were 
required  to  show  how  well  they 
communicate  mathematical  ideas  and 
concepts  and  approaches  to  solving 
problems.  On  the  written-response 
section  of  the  diploma  examinations, 
students  are  expected  to  show  all  of 
the  steps  in  solving  a problem,  explain 
their  approach  to  solving  the  problem, 
and  solve  the  problem.  The 
explanation  can  occur  in  many  ways, 
algebraically  if  the  student  clearly 
defines  variables,  in  written  form,  or 
through  the  use  of  diagrams. 


Biology  30 

approximately  2 060  students  received 
final  course  marks  in  the  revised  (pilot) 
Biology  30  course.  These  students 
were  exempt  from  writing  a 1994 
Biology  30  diploma  examination.  The 
new  Biology  20  course  was 
implemented  in  the  1993-94  school 
year.  The  proportion  of  Grade  1 1 
students  who  completed  both  the 
Biology  20  and  Biology  30  courses  in 
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Although  students  have  been  exposed  to 
many  different  mathematical  concepts 
throughout  their  study  of  mathematics,  it 
is  interesting  to  note  that  many  students 
rely  on  previously  learned  mathematics 
ideas  when  it  comes  to  solving  problems 
rather  than  using  the  mathematics  used  in 
Mathematics  30. 

The  AOT  results  indicate  that  overall 
student  performance  on  the  Mathematics 
30  diploma  examinations  appears  to  be 
improving.  This  is  supported  by  student 
performance  on  the  June  exams  over  the 
last  three  years.  While  performance  on 
January  examinations  has  been  about  the 
same,  performance  on  the  June 
examinations  has  been  steadily 
improving.  In  June  1992,  32.8%  of  the 
students  did  not  achieve  the  acceptable 
standard',  in  June  1993,  32.7%  did  not 
achieve  the  acceptable  standard',  and  in 
June  1994,  30.2%  of  the  students  did  not 
achieve  the  acceptable  standard. 


the  same  year  decreased  significantly. 
The  new  Biology  20  course  and  the 
old  Biology  30  course,  on  which  the 
1993-94  Biology  30  Diploma 
Examinations  are  based,  are  not 
congruous. 

Approximately  51%  of  the  population 
that  wrote  a Biology  30  diploma 
examination  in  1993-94  also  wrote 
diploma  examinations  in  three  or  more 
additional  courses.  This  means  that 
only  slightly  more  than  half  of  the 
Biology  30  population  attempted  to 
complete  sufficient  courses  in  one 
year  to  qualify  for  the  Advanced  High 
School  Diploma.  Compared  to 
Mathematics  30,  Chemistry  30,  and 
Physics  30,  Biology  30  has  the  lowest 
proportion  of  students  who  write 
diploma  examinations  in  four  or  more 
courses  during  a school  year. 
Notwithstanding,  Biology  30  is 
primarily  for  students  intending  to 
pursue  post-secondary  studies.  The 
Biology  30  population  comprises 
more  females  than  males.  About  58% 
of  students  writing  Biology  30 
Diploma  Examinations  are  female; 
42%  are  male. 
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What  is  the  overall  performance  of 
students  on  the  examinations? 

The  overall  performance  of  students 
who  wrote  the  Biology  30  diploma 
examinations  during  the  1993-94  school 
year  was  similar  to  performance  in  the 
previous  year.  This  is  reflected  in  the 
examination  average  (65.5%)  and  in  the 
proportion  of  students  (81.4%)  who 
achieved  the  acceptable  standard.  A 
significant  proportion  of  students 
(23.2%)  achieved  the  standard  of 
excellence.  Although  18.6%  of  the 
students  did  not  meet  the  acceptable 
standard,  6.7%  of  all  students  obtained 
marks  ranging  from  45%  through  49%. 
Most  of  these  students  would  be  able  to 
achieve  the  acceptable  standard  on 
future  diploma  examinations  in  Biology 
30  if  they  receive  additional  instruction. 

The  percentage  of  female  students  who 
achieved  the  acceptable  standard  on  the 
Biology  30  diploma  examinations  was 
79.5  compared  with  84.1  of  male 
students.  The  percentage  of  females 
who  achieved  the  standard  of  excellence 
on  the  Biology  30  diploma 
examinations  was  21.4  compared  with 
25.8  of  males.  The  Biology  30  diploma 
examinations  average  for  females  was 
64.5%  compared  with  66.9%  for  males. 

As  in  the  previous  three  years,  the  group 
that  attained  the  highest  examination 
average  (see  Table  7-8)  wrote  Biology 
30  diploma  examinations  while  in  their 
second  year  of  high  school.  This  group 
contains  a high  proportion  of  students 


who  plan  to  take  additional  30-level 
science  courses  in  their  third  year  of 
high  school. 


Acceptable  Standard 

Students  who  achieved  the  acceptable 
standard  but  not  the  standard  of 
excellence  (58.2%  of  the  population) 
understood  the  basic  functions  of  human 
body  structures.  They  recalled  the 
properties  of  key  biological  substances 
and  therefore  selected  correct 
physiological  functions  for  these 
substances.  This  group  of  students 
interpreted  correctly  data  presented  in 
simple  graphs,  tables,  and  diagrams. 
However,  they  found  it  difficult  to 
interpret  complex  graphs  and  tables  that 
presented  interrelated  sets  of  data. 

These  students  related  biology  concepts 
to  simple  human  experiences  but  found 
it  difficult  to  analyze  multistep  human 
physiology  problems.  Questions  that 
required  the  understanding  of  biology 
concepts  within  the  context  of 
technology  (inducing  and  monitoring  of 
hypothermia,  treating  cystic  fibrosis) 
proved  difficult.  The  basic  language  of 
biology  was  understood  by  these 
students,  but  specialized  terms  that 
incorporate  sophisticated  science 
concepts  (active  transport,  reabsorption, 
concentration,  hypothesis)  created 
problems  for  them.  The  students  in  this 
group  composed  one-  or  two-sentence 
answers  that  were  clear  and  logical  for 
questions  that  contained  only  one 
component.  However,  they  had 


difficulty  creating  multistep  paragraph 
responses  to  problems  that  required 
developing  several  ideas.  Their  answers 
to  these  questions  frequently  consisted 
of  recalled  information  that  did  not 
address  the  central  issues  of  the 
problems  posed.  These  students  did  not 
clearly  express  cause-and-effect 
relationships. 

Students  who  failed  to  achieve  the 
acceptable  standard  (18.6%  of  the 
population)  did  not  understand  basic 
functions  of  human  body  structures. 
They  found  it  difficult  to  interpret  data 
represented  in  diagrams  and  tables. 

They  did  not  know  the  functional 
properties  of  key  biological  substances. 
They  were  unable  to  organize 
sequentially  the  major  steps  of 
physiological  processes.  This  group  of 
students  could  not  compose  clear  and 
logical  explanations  for  single- 
component problems.  Their  responses 
indicated  that  they  did  not  adequately 
understand  the  meaning  of  the  questions. 

Standard  of  Excellence 

Students  who  achieved  the  standard  of 
excellence  (23.2%  of  the  population) 
demonstrated  consistent  performance 
throughout  the  examination,  whether 
they  selected  or  created  responses.  They 
could  recall  precise  knowledge  about 
structure  and  function  of  human  organs. 
They  could  then  use  this  knowledge  to 
solve  multistep  problems.  They  were 
able  to  trace  the  pathways  that  materials 
follow  through  the  human  body  and 


Table  7-7 

Biology  30  Diploma  Examination 
Four- Year  Comparison  by  Population  Percent  and  Achievement  Averages 


Year 

Subgroup 

Grade  1 1 
Students 

Grade  12 
Students 

Atypical 
Exam  Writers* 

Transferred 
in  From 
Outside  the 
Province 

1993-94 

Percent  of  Population 

4.3 

84.4 

7.1 

4.2 

Examination  Average 

71.7 

65.3 

59.0 

65.5 

1992-93 

Percent  of  Population 

10.2 

79.5 

6.3 

4.0 

Examination  Average 

69.4 

64.6 

59.4 

64.3 

1991-92 

Percent  of  Population 

11.2 

78.8 

5.7 

4.3 

Examination  Average 

67.5 

62.6 

56.6 

63.3 

1990-91 

Percent  of  Population 

9.1 

81.1 

5.2 

4.6 

Examination  Average 

69.5 

63.5 

58.9 

65.2 

*This  group  includes  repeaters,  individuals  challenging  the  examinations,  and  students  without  a school-awarded  mark. 
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Table  7-8 


Biology  30 

Four-Year  Comparison  of  Selected 
Population  and  Achievement  Indicators 


1990-91 

1991-92 

1992-93 

1993-94 

Number  of  Students 

19  167 

20313 

21  604 

17  943 

Female/Male  Proportions  (%) 

59/41 

58/42 

58/42 

58/42 

Students  Achieving  Acceptable  Standard 
on  Diploma  Exam  (%) 

77.7 

76.5 

81.6 

81.4 

Students  Achieving  Standard  of  Excellence 
on  Diploma  Exam  (%) 

22.3 

20.5 

22.1 

23.2 

arrange  physiological  processes  in 
sequential  order.  They  could  form 
hypotheses  based  on  initial  data  and 
then  evaluate  them  in  the  light  of  new 
data.  They  could  evaluate 
experimental  designs  and  explain  why 
the  results  could  not  be  used  to 
support  certain  decisions.  Their 
compositions  demonstrated  a clear 
understanding  of  cause-and-effect 
relationships.  They  used  scientific 
vocabulary  with  precision  and 
communicated  clearly. 

Do  the  population  and  performance 
data  reveal  any  significant  trends? 

The  total  number  of  students  who 
obtained  a final  course  mark  in 
Biology  30  increased  by 
approximately  12.7%  from  1990-91  to 
1992-93  but  then  decreased  by  about 
7.4%  in  1993-94,  if  the  population 
who  completed  the  revised  (pilot) 
Biology  30  course  is  included.  This 
decrease  of  approximately  1 600 
students  is  mainly  accounted  for  by  a 
decrease  in  the  number  of  Grade  1 1 
students  (2  243  to  785)  who  received 


What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

In  the  1993-94  school  year,  fewer 
students  (14  798)  with  corresponding 
school-awarded  marks  wrote  the 
Chemistry  30  diploma  examinations 
than  in  the  previous  year  (16  865),  a 
drop  of  2 067  students.  This  is 


final  course  marks  in  Biology  30  in 
1993-94.  As  explained  earlier,  the 
implementation  of  the  new  Biology  20 
course  in  the  1993-94  school  year 
caused  this  change  in  population  size. 
The  combined  number  of  second-year 
Grade  12  students  and  Grade  12 
students  who  transferred  into  the 
province  and  who  obtained  Biology  30 
diploma  examination  marks  also 
decreased  (2  258  to  2 048).  A few 
students  who  were  enrolled  in  the 
schools  that  offered  Science  30  (pilot) 
may  have  chosen  that  course  in  place 
of  Biology  30. 

From  1990-91  through  1993-94,  the 
created-response  section  of  the 
Biology  30  examinations  changed  in 
that  increasing  emphasis  was  placed 
on  solving  problems  that  were  set  in 
authentic  science  research  contexts. 
Students  were  expected  to  solve  these 
problems  by  using  scientific  process 
skills  and  by  relating  their 
understanding  of  science  concepts  to 
technological  and  societal  issues.  In 
keeping  with  these  changes,  the 
individual  items  were  reduced  in 
number  (from  7 to  4),  but  each  item 

Chemistry  30 

explained  in  part  by  1 558  students 
participating  in  the  pilot  for  the  new 
Chemistry  30  program  and  an 
estimated  683  Grade  1 1 students 
electing  not  to  take  Chemistry  30  in 
their  second  year  of  high  school.  In 
addition,  some  of  the  630  students 
enrolled  in  the  Science  30  pilot  may 
have  participated  in  the  chemistry 


increased  in  scope.  The  examinations 
as  a whole  remained  accessible  to  the 
group  of  students  who  achieve  at  the 
acceptable  level  as  well  as  those 
students  who  achieve  at  the  level  of 
excellence.  In  fact,  the  percentage  of 
students  in  both  these  categories 
increased  during  the  past  two  school 
years  (refer  to  Table  7-8). 

The  percentage  of  females  and  males 
who  obtain  Biology  30  diploma 
examination  marks  has  changed  very 
little  during  the  past  four  school  years. 
However,  the  proportion  of  females 
who  achieved  the  acceptable  standard 
in  Biology  30  increased  by 
approximately  3%  from  1990-91  to 
1993-94;  whereas  the  proportion  of 
males  who  achieved  the  acceptable 
standard  for  this  same  period 
increased  by  4%. 

This  improvement  in  achievement  is 
also  indicated  by  the  achievement- 
over-time  study  for  Biology  30.  The 
equated  average  percentage  on  the 
machine-scored  component  increased 
significantly  from  1991  to  1994. 


program  had  the  pilot  not  occurred. 
The  writing  population  represents 
almost  one-half  of  the  students  who 
wrote  either  the  English  30  or  English 
33  diploma  examinations.  This 
number  appears  to  meet  the  expected 
size  of  the  target  group,  when  the 
number  of  students  involved  in  the 
pilot  is  taken  into  account.  Not  all 
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students  capable  of  achieving  the 
acceptable  standard  or  the  standard  of 
excellence  were  enrolled  in  chemistry. 
For  example,  some  students  who  were 
successful  in  Physics  30  did  not  take 
Chemistry  30.  Since  these  students 
are  likely  to  be  successful  in  the 
chemistry  program,  they  could  be 
encouraged  to  enroll. 

What  is  the  overall  performance  of 
students  on  the  examinations? 

The  overall  performance  of  students 
who  wrote  the  Chemistry  30  diploma 
examinations  during  the  1993-94 
school  year  was  satisfactory  (see 
Figure  7-6).  In  1993-94,  77.7%  of  the 
students  writing  Chemistry  30  attained 
diploma  examination  marks  at  or 
above  the  acceptable  standard,  which 


is  down  from  81.7%  last  year.  This 
drop  is  partially  due  to  the  reduced 
number  of  high-achieving  Grade  1 1 
students  taking  the  course.  The 
success  of  the  Grade  12  student  taking 
Chemistry  30  for  the  first  time, 
(77.4%)  in  achieving  the  acceptable 
standard  is  also  lower  than  the  last 
year  (80.3%).  A significant 
proportion  of  the  students,  21.9%, 
attained  diploma  examination  marks  at 
or  above  the  standard  of  excellence 
(see  Figure  7-6).  This  percentage  is 
shghtly  higher  than  the  21.1%  of  the 
students  who  achieved  the  standard  of 
excellence  last  year.  Many  of  the 
students,  7.8%,  attained  marks  ranging 
from  44%  to  49%.  These  students 
could  achieve  a pass  with  further 
instruction. 

The  percentage  of  female  students 


who  achieved  the  acceptable  standard 
on  the  Chemistry  30  diploma 
examination  was  79.5%  compared 
with  79.8%  of  male  students.  The 
percentage  of  females  who  achieved 
the  standard  of  excellence  on  the 
examinations  was  20.6%  compared 
with  25.3%  of  male  students.  The 
average  for  females  on  the  Chemistry 
30  examinations  was  63.9%  compared 
with  65.2%  for  males.  These 
differences  may  be  explained,  in  part, 
by  the  higher  participation  rate  of 
females  in  this  subject.  One  would 
expect  the  participation  rate  to  be  the 
same  as  the  normal  gender  distribution 
at  that  age,  51/49 — male/female 
proportion  in  percent. 

The  distribution  of  Chemistry  30 
Diploma  Examination  marks  is  given 
in  Figure  7.6. 


Figure  7-6 
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Acceptable  Standard 

Students  who  achieved  the  acceptable 
standard  but  not  the  standard  of 
excellence  (55.8%  of  the  population) 
were  able  to  do  stoichiometry  of  more 
than  one  step  as  long  as  it  did  not 
involve  writing  and  balancing 
equations  for  chemical  reactions.  They 
were  able  to  calculate  the  amount  of 
energy  required  to  warm  a given  mass 
of  water,  the  concentration  of  an  acid, 
given  the  concentration  and  volume  of 
the  titrant,  and  the  volume  of  acid 
provided  that  the  ratio  between  the 
sample  and  titrant  was  1:1.  They  were 
able  to  assign  oxidation  numbers  to 
most  atoms  and  are  capable  of 
balancing  chemical  reactions  using 
half-reactions.  These  students  could 
transpose  data  to  and  from  graphical 
form  and  had  a good  grasp  of  essential 


Table  7-9 
Chemistry  30 

Four- Year  Comparison  of  Selected 
Population  and  Achievement  Indicators 


1990-91 

1991-92 

1992-93 

1993-94 

Number  of  Students 

15  312 

16  156 

16  865 

14  798 

Male/Female  Proportions  (%) 

48/52 

48/52 

48/52 

48/52 

Students  Achieving  Acceptable  Standard 
on  Diploma  Examination  (%) 

81.5 

83.0 

81.6 

79.6 

Students  Achieving  Standard  of  Excellence 
on  Diploma  Examination  (%) 

22.8 

22.5 

21.1 

22.9 
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definitions  and  terms  such  as 
conjugate  base,  Arrhenius  acid,  pH, 
and  exothermic-endothermic.  They 
successfully  ranked  species  on  the 
basis  of  their  properties,  ranked 
reactions  on  the  basis  of  the 
magnitude  of  the  energy  involved,  and 
were  able  to  use  and  extract  pertinent 
information  from  the  data  booklet. 
However,  they  had  difficulty 
recognizing  ratios  other  than  1 : 1 in 
acid-base  chemistry  and  solving 
complex  stoichiometric  problems. 
They  usually  recognized  the 
correctness  of  a situation  for  most 
concepts,  but  they  had  difficulty 
designing  their  own  experimental 
procedures  based  on  these  concepts. 
These  students  were  usually  able  to 
organize  their  creative  responses  in  an 
understandable  fashion,  though  they 
had  difficulty  with  communication 
conventions,  such  as  spelling, 
significant  digits  and,  especially,  SI 
prefixes. 

These  individuals  worked  best  at  the 
macroscopic  level  and  as  a result  did 
well  on  the  multiple-choice  questions. 
They  averaged  approximately  50%  on 
the  created-response  sections  of  the 
examination. 

Students  who  did  not  achieve  the 
acceptable  standard  of  performance 
on  the  Chemistry  30  Diploma 
Examination  (22.3%)  had  difficulty 
solving  stoichiometric  problems  other 
than  those  involving  a single-step 


addition/subtraction  problem,  such  as 
calculating  the  voltage  of  a cell  given 
the  half-reactions  or  determining  the 
hydronium  ion  concentration  given  the 
pH.  These  students  were  unable  to 
transfer  data  to  or  from  graphical  form 
or  to  use  data  to  predict  trends, 
patterns,  or  properties.  They  also  had 
difficulty  in  predicting  chemical 
changes  and  writing  appropriate 
chemical  equations  for  the  changes 
involved.  In  general,  these  students 
had  difficulty  in  creating  their 
responses  and  communicating  their 
ideas  clearly.  As  a result,  they  did  not 
do  well  on  the  created-response 
(numerical  and  written)  section  of  the 
examinations.  They  did,  however, 
recognize  correct  statements  about 
essential  concepts  and  had  their 
greatest  success  on  the  selected 
(multiple-choice)  section  of  the 
examinations. 

Standard  of  Excellence 

Students  who  achieved  the  standard  of 
excellence  (21.9%)  were  able  to  solve 
any  stoichiometric  problem  and  to 
recognize  ratios  other  than  1 : 1 in  acid- 
base  chemistry.  They  also  recognized 
relationships  between  the  dissolved 
solute  and  the  resulting  species,  and  as 
a result  were  able  to  accurately  predict 
physical  and  chemical  properties  of 
solutions.  They  had  no  difficulty 
distinguishing  between  strength  and 
concentration,  nor  did  they  have 
difficulty  inferring  properties  from 


graphical  data.  They  were  able  to 
recognize  when  a reaction  would  or 
would  not  occur  and  thus  did  not 
always  assume  that  reaction  was 
forthcoming  when  two  or  more 
reagents  are  combined.  They  did  have 
difficulty  in  dealing  with  comparisons 
based  upon  logarithmic  functions  and 
involving  practical  applications  such 
as  determining  the  amount  of 
additional  water  required  to  raise  the 
pH  of  a solution.  They  also  had 
difficulty  in  rank  ordering  solutions 
based  upon  pH  (concentration, 
strength,  and  nature  of  solute)  rather 
than  strength.  In  general,  they  were 
able  to  apply  their  knowledge  in  new 
and  novel  situations  and  as  a result 
were  very  successful  in  creating 
responses.  These  students  had  no 
difficulty  organizing  and 
communicating  their  responses.  They 
did  well  on  all  sections  of  the 
examination,  and  their  work  on  the 
created-response  sections  were  as 
expected. 

Do  the  population  and  performance 
data  reveal  any  significant  trends? 

The  previously  identified  trend  of 
significant  Grade  1 1 student 
participation  did  not  continue.  The 
number  of  Grade  1 1 students  dropped 
significantly,  from  8.0%  of  the 
population  to  3.5%.  This  was  partially 
due  to  the  implementation  of  the  new 
Chemistry  20  curriculum.  However, 
the  Grade  1 1 student  achievement  in 


Table  7-10 

Chemistry  30  Diploma  Examination 

Five-Year  Comparison  by  Population  Percent  and  Achievement  Averages 


Year 

Subgroup 

Grade  1 1 
Students 

Grade  12 
Students 

Atypical 
Exam  Writers* 

Transferred  In 
From  Outside 
of  Province 

1993-94 

Percent  of  Population 

3.5 

86.8 

4.7 

5.0 

Examination  Average 

70.2 

63.4 

56.6 

65.9 

1992-93 

Percent  of  Population 

8.0 

82.7 

4.4 

4.9 

Examination  Average 

67.8 

64.3 

57.7 

66.1 

1991-92 

Percent  of  Population 

8.5 

82.5 

4.0 

5.0 

Examination  Average 

68.7 

64.5 

58.1 

68.2 

1990-91 

Percent  of  Population 

7.0 

83.6 

4.2 

5.2 

Examination  Average 

69.9 

64.5 

58.5 

67.9 

1989-90 

Percent  of  Population 

1.2 

90.3 

4.4 

4.1 

Examination  Average 

63.9 

62.7 

56.7 

66.5 

*This  group  includes  repeaters,  individuals  challenging  the  examination,  and  students  without  a school-awarded  mark. 
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Chemistry  30  continued  to  improve: 
their  examination  mark  average  is  up 
from  67.8%  to  70.2%,  with  36.6%  of 
these  students  achieving  the  standard  of 
excellence  and  48.8%  achieving  the 
acceptable  standard  but  not  the  standard 
of  excellence.  This  high  success  is 
partially  due  to  the  International 
Baccalaureate  Chemistry  program 
where  students  in  the  second  year  of  the 
program  (Grade  11)  write  the 
Chemistry  30  diploma  examinations.  It 
is  expected  that  the  number  of  Grade  1 1 
students  that  enrolled  in  Chemistry  30 


will  return  to  the  pre-pilot  level  of 
around  8%  in  1994-95. 

The  achievement  of  fourth-year  and 
out-of-province  students  continued  to 
decrease. 

The  overall  achievement  of  students 
writing  the  Chemistry  30  diploma 
examinations  declined  slightly  this 
year  except  for  students  achieving  the 
standard  of  excellence.  There  was  no 
significant  improvement  or  decline  in 
any  specific  content  area;  however,  an 


attempt  by  all  students  to  improve  the 
organization  of  their  responses  in  the 
written-response  section  of  the 
examination  was  noted. 

Unfortunately,  one  trend  has  been 
identified  that  reflects  a poor 
understanding  of  an  essential  concept, 
specific  heat  capacity.  Specific  heat 
capacity  is  a measure  based  upon  mass 
of  a substance  and  not  its  volume. 

The  volume  of  a sample,  such  as  a 
gas,  may  vary  greatly  whereas  the 
mass  does  not. 


Physics  30 


What  are  the  characteristics  of  the 
student  population  that  wrote  the 
examinations? 

In  1993-94,  7 488  students  with 
corresponding  school-awarded  marks 
wrote  the  Physics  30  diploma 
examinations.  This  represents  a 
decrease  of  970  students  from  the 
1992-93  school  year.  This  apparent 
drop  in  the  number  of  students  is  due 
to  a combination  of  three  factors: 
approximately  630  students 
participated  in  the  pilot  of  the  revised 
Physics  30  course  of  studies; 
approximately  610  students 
participated  in  the  new  Science  30 
course  of  studies,  of  which  some  may 
have  otherwise  taken  Physics  30;  and 
some  Grade  1 1 students  who,  in  other 
years,  have  chosen  to  take  Physics  30 


and  write  the  diploma  exam,  did  not 
because  the  exam  was  based  on  the  old 
program.  For  males,  the  participation 
rate  in  Physics  30  was  63.6%  (4  763 
students)  and  for  females  36.4%  (2  725 
students).  Compared  to  1992-93,  the 
participation  rate  for  males  and  females 
has  remained  relatively  constant. 

As  shown  in  Figure  2-3,  Physics  30 
students  write,  on  average,  4.4  different 
diploma  examinations.  Only  students 
writing  Fran9ais  30  write  more. 

Physics  30  continues  to  be  a course 
designed  for  students  going  on  to 
academic  and  technological  post- 
secondary physics/science-related 
programs.  Registration  in  Physics  30 
should  continue  to  be  encouraged,  as 
many  career  opportunities  require  the 


Figure  7-7 


Physics  30 

Distribution  of  Diploma  Examination  Marks 
1993-94  School  Year 


□ Students  achieving  the  acceptable  standard  | Students  achieving  the 

but  not  the  standard  of  excellence.  ! i standard  of  excellence. 


knowledge  and  skills  supported  by  the 
high  school  physics  program. 


What  is  the  overall  performance  of 
students  on  the  examinations? 

The  overall  performance  of  students 
writing  the  Physics  30  diploma 
examinations  during  the  1 993-94 
school  year  was  satisfactory  (see 
Figure  7-7).  Although  actual  diploma 
results  were  consistent  with  the 
performance  in  previous  years  (Table 
7-11),  more  students  than  expected 
achieved  the  standard  of  excellence. 
The  proportion  of  students  with 
diploma  examination  marks  at  or 
above  the  standard  of  excellence  was 
32.3%.  This  represents  an  increase  of 
5.7%  from  the  results  in  the  previous 
year.  The  proportion  of  students  that 
failed  to  achieve  the  acceptable 
standard  was  15.2%,  compared  to  the 
previous  year’s  proportion  of  18.6%. 

Acceptable  Standard 

In  1993-94,  students  who  achieved 
the  acceptable  standard  but  not  the 
standard  of  excellence  (52.5%)  could 
reliably  state  and  solve  those  problems 
that  could  be  related  quickly  to  an 
equation  in  the  data  booklet.  Also, 
students  demonstrated  some  success  in 
solving  simple  two-step  problems. 

For  this  group,  laboratory  skills  were 
limited  to  using  laboratory  data  to 
verify  known  physics  information. 
These  students  were  capable  of 
producing  a graph  with  an  accurate 
best-fit  line,  developing  a procedure  to 
determine  the  slope  of  a graph,  and 
calculating  quantities  such  as  stopping 
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voltages,  centripetal  force,  and 
distances  travelled  by  electromagnetic 
waves.  They  tended  to  use  item- 
specific  methods  in  their  problem 
solving,  and  rarely  used  the  major 
generalizations  of  physics,  such  as 
Newton’s  laws  or  those  of  the 
conservation  of  energy  or  charge.  In 
addition,  students  had  difficulty 
communicating,  for  example,  how 
negative  charges  move  when  objects 
are  charged  either  by  induction  or 
conduction.  Thus,  students 
performing  near  the  acceptable 
standard  showed  only  limited 
understanding  of  the  full  scope  of  the 
Physics  30  program  of  studies.  Within 
this  restricted  range  of  content,  such 
students  performed  well. 

In  addition,  students  with  final  course 
marks  near  the  acceptable  standard 
used  the  data  booklet  supplied  more  as 
a crutch  than  as  a summary  of  the 
physics  content.  Those  who  achieved 
this  standard  showed  that  they  could 
use  the  equations  and  information 
provided  to  solve  problems  requiring 
single-step  calculations  and  simple 
two-step  calculations.  They  were  also 
competent  in  recalling  facts  and 
essential  definitions  related  to  specific 
concepts.  Many  students  found  it 
difficult  to  translate  definitions  into 
alternative  forms  and  to  judge  whether 
a data  book  value  was  valid  within  the 
range  of  values  given  in  a particular 
problem.  These  students  had  difficulty 
identifying  the  relationship  between 
two  variables  that  had  been  expressed 
in  a graphical  representation.  Students 
achieving  at  this  standard  found  it 


difficult  to  make  predictions  based  on 
information  or  data  presented.  They 
found  the  multiple-choice  section  far 
easier  than  the  written-response 
section  and  typically  scored  30% 
higher  on  this  section  of  the  exam. 

Standard  of  Excellence 

Students  achieving  the  standard  of 
excellence  (32.3%)  showed  far  more 
flexibility  and  creativity  than  those 
achieving  the  acceptable  standard  but 
not  the  standard  of  excellence . They 
sought  to  use  general  methods  of 
solution  and  were  not  afraid  to  use 
conservation  laws  to  solve  unusual 
problems.  They  illustrated  a 
transference  of  knowledge  from  one 
area  of  physics  to  another,  and 
expressed  their  answers  clearly  and 
concisely.  They  made  inferences  that 
were  not  part  of  their  “known”  area  of 
physics.  These  students  were  able  to 
use  generalizations  of  physics,  and  to 
distinguish  between  vectors  and 
scalars,  or  forces  and  fields. 

In  1993-94,  students  with  final  course 
marks  near  the  standard  of  excellence 
tended  to  use  the  data  booklet  to 
support  their  problem-solving 
strategies,  but  were  not  overly 
dependent  upon  it.  These  students 
stated  and  easily  recognized 
relationships  between  variables.  They 
were  able  to  derive  equations  as 
needed,  design  procedures  for  a 
laboratory  activity,  and  communicate 
effectively  how  negative  charges 
move  when  objects  are  charged 
through  induction  or  conduction. 


Those  who  achieved  just  below  this 
standard  had  some  difficulty  with 
questions  that  required  multistep 
solutions,  and  needed  explicit  cues 
before  they  were  able  to  use  a wider 
range  of  problem-solving  strategies. 

In  many  cases,  such  students  solved 
more  complex  problems  in  the 
multiple-choice  format  but 
experienced  difficulty  with  similar 
concepts  tested  in  a written-response 
format.  They  were  adept  at  selecting 
the  correct  response  in  the  multiple- 
choice  section,  and  in  creating  their 
own  responses  for  similar  questions  in 
the  numerical-response  and  written- 
response  sections.  When  confronted 
with  a problem  requiring  the  use  of 
two  or  more  steps,  they  created  their 
own  procedures  for  solving  problems. 
Many  of  their  responses  to  the  written- 
response  questions  showed  a high 
level  of  sophistication. 

Do  the  population  and  performance 
data  reveal  any  significant  trends? 

Based  on  the  actual  results  of  students 
writing  the  Physics  30  diploma 
examinations,  achievement  has  been 
fairly  consistent  (Table  7-11). 

Students  continue  to  do  well  on  the 
multiple-choice  section  of  the 
examinations  and  continue  to  improve 
on  the  numerical-response  section.  In 
the  written-response  section,  there 
continues  to  be  a decrease  in  the 
number  of  students  who  leave 
questions  blank. 


Table  7-11 
Physics  30 

Four- Year  Comparison  of  Selected 
Population  and  Achievement  Indicators 


1990-91 

1991-92 

1992-93 

1993-94 

Number  of  Students 

7 736 

8 196 

8 458 

7 488 

Male/Female  Proportions  (%) 

66/34 

65/35 

64/36 

64/36 

Students  Achieving  Acceptable  Standard 
on  Diploma  Examination  (%) 

83.1 

81.4 

81.5 

84.8 

Students  Achieving  Standard  of  Excellence 
on  Diploma  Examination  (%) 

23.0 

22.6 

26.6 

32.3 
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Achievement  has  shown  improvement 
in  some  specific  areas.  Students  have 
shown  a marked  increase  in  their  ability 
to  solve  problems  involving  routine 
calculations.  They  perform  well  on 
problems  requiring  single-step  or  two- 
step  calculations  but  continue  to  have 
major  difficulties  using  ratios.  A 
second  area  that  shows  improvement  is 
in  their  understanding  that  electrons 
can  be  accelerated  to  high  speeds  when 
in  the  presence  of  an  intense  electric 
field,  and  that  when  the  electrons  stop 


suddenly  and  release  a photon,  the 
photon’s  energy  is  equivalent  to  the 
energy  of  the  accelerating  electron  just 
before  it  stops.  Students  are  still 
somewhat  confused  between  electric 
and  magnetic  fields,  and  in  their 
understanding  of  the  movement  of 
charges  when  explaining  induction 
and  conduction.  However,  students 
continue  to  show  strength  in  problems 
requiring  them  to  present  their  data 
graphically  and  in  the  use  of  graphical 
analysis. 


The  percentage  of  females  writing 
Physics  30  diploma  examinations  has 
increased  since  1990-91  but  ever  so 
slowly.  In  addition,  females  have 
consistently  achieved  a slightly  higher 
average  on  diploma  exams  in  the  past. 
This  trend  continued  in  1993-94  and 
is  supported  by  a greater  number  of 
females  now  achieving  the  acceptable 
standard  and  the  standard  of 
excellence  than  males. 
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Appendix  A 

Diploma  Examination  Development  Process 

I / 


The  staff  of  the  Student  Evaluation 
Branch  give  great  care  and  attention  to 
the  development  and  marking  of  all 
diploma  examinations  to  ensure  that 
students’  marks  on  diploma 
examinations  arc  fair  and  equitable 
measures  of  their  achievement. 

Professional  staffol  the  Student 
Evaluation  Branch  uork  with  many 
individuals  in  the  complex  process  of 
developing  diploma  examinations. 
Classroom  teachers,  school  and 
jurisdiction  administrators, 
representatives  Irom  post -secondary 
institutions,  and  stall  ol  the 
Curriculum  Standards  Branch. 
Language  Services  Branch,  and 


regional  offices  of  Alberta  Education 
are  all  involved. 

It  takes  approximately  1 8 months  to 
complete  the  development  of  a 
diploma  examination.  The 
examination  development  process 
follows  these  steps: 

• Planning 

• Approving  Examination  Blueprints 

• Developing  Examination  Questions 

• Constructing  and  Administering 
Field  Tests 


• Analysing  and  Revising  Questions 

• Constructing  the  Examinations 

• Approving  the  Examinations 

• Printing  and  Administering  the 
Examinations 

• Marking  the  Examinations 

• Analysing  and  Reporting  the  Results 

The  procedures  outlined  below  were 
in  effect  for  the  1993-94  school  year. 

They  have  been  revised  for  the  1994- 
95  school  year. 


Planning 

The  first  step  in  the  planning  phase  is 
to  prepare  (under  direction  from  the 
Curriculum  Standards  Branch) 
specifications  based  on  the  goals  and 
objectives  of  the  curriculum  for  each 
subject. 

Examination  developers  in  each 
diploma  examination  course  then 
prepare  an  interim  examination 
blueprint.  An  examination  blueprint  is 
an  overall  plan  used  to  guide  the 
development  of  an  examination.  If  a 
diploma  examination  is  undergoing 
extensive  revision  because  of 
curricular  change,  or  if  a new 
examination  is  to  be  developed,  an 
advisory  committee  of  teachers  and 
subject  consultants  will  contribute  to 
decisions  about  the  emphasis  and 
design  of  the  examination. 

As  blueprints  are  drafted  and 
examinations  designed,  examination 
developers  and  advisory  committees 
must  address  these  questions: 

• What  knowledge  and  skills  can 
students  be  expected  to  possess? 

• How  can  the  various  parts  of  the 
curriculum  best  be  tested? 


• What  should  be  the  weighting  for 
each  part  of  the  curriculum  tested? 

• How  long  and  how  demanding  should 
the  examination  be? 

• What  format  will  produce  the  most 
valid  results? 

• What  types  of  questions  will  be  most 
valid  and  reliable?  (Multiple  choice, 
short  answer,  extended  written 
response?) 

• How  should  the  examination  be 
organized  to  produce  valid  and 
reliable  results? 

• How  will  students’  responses  be 
scored?  What  will  the  criteria  be  for 
scoring? 

• How  should  the  results  be  reported? 

• Who  will  receive  the  results? 

To  ensure  that  each  examination  is  a 
fair  and  equitable  measure  of  students’ 
accomplishments  in  the  course,  and  to 
ensure  that  results  will  be  meaningful 
and  reliable,  examination  developers 
incorporate  curricular  as  well  as 
statistical  standards  into  the 
examination  design. 


Examination  questions  are  developed  to 
reflect  the  range  of  expectations  for 
students’  achievement  that  is  embedded 
in  the  curriculum.  Each  question  is 
classified  and  cross-referenced  to  the 
curriculum  in  terms  of  the  specified 
knowledge,  skills,  and  understanding 
the  question  is  designed  to  assess.  The 
range  of  difficulty  embedded  in  the 
curriculum  dictates  the  range  of 
difficulty  of  examination  questions. 

Field  testing  confirms  and  validates  the 
curricular  expectations  as  reflected  by 
the  questions.  Item  analysis  of  the 
machine-scorable  field  tested  questions 
provides  technical  data  about  the 
relative  difficulty  of  questions  and 
about  the  technical  strength  of  sets  of 
questions.  Field  tested  questions  are 
kept  for  use  on  a diploma  examination 
or  are  re-field  tested  to  ensure  that  they 
meet  appropriate  technical  and 
curricular  standards,  or  such  questions 
are  discarded. 

Approving  Examination 
Blueprints 

When  examination  developers  and  their 
advisory  committees  have  developed  an 
examination  design  and  blueprint. 
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including  criteria  for  scoring  written 
responses,  a committee  of  Alberta 
Education  staff  (Regional  Offices  of 
Alberta  Education,  the  Curriculum 
Standards  Branch,  Language  Services 
Branch,  and  the  Student  Evaluation 
Branch)  review  the  proposed  design. 

The  blueprint  and  design  the  committee 
recommends  is  then  reviewed  by  an 
Examination  Review  Committee 
consisting  of  representatives  nominated 
by  the  Alberta  Teachers’  Association, 
the  Conference  of  Alberta  School 
Superintendents,  the  Universities 
Co-ordinating  Council,  the  Public 
Colleges  of  Alberta,  and  Alberta 
Education.  This  committee  makes 
recommendations  regarding  the  final 
examination  design  to  the  Director  of 
the  Student  Evaluation  Branch. 

Developing 

Examination 

Questions 

Following  approval  of  the  examination 
design,  format,  and  blueprints, 
examination  developers  plan  for 
question  development.  On  the 
recommendations  of  superintendents, 
classroom  teachers  from  across  the 
province  are  selected  to  work  on 
question  development  committees 
chaired  by  examination  developers  from 
the  Student  Evaluation  Branch. 

Professional  examination  development 
staff  of  the  Student  Evaluation  Branch 
ensure  that  teachers  serving  on  question 
development  committees  understand  the 
technical  principles  of  question 
construction.  The  teacher  committees 
develop  questions  that  meet  the 
curricular  and  technical  standards 
incorporated  in  the  examination  design 
and  blueprints,  and  that  will  fairly  test 
the  skills  and  concepts  that  students  can 
be  expected  to  have  acquired. 

Questions  developed  in  committee  are 
then  carefully  screened,  edited,  and 
revised  so  that  all  blueprint 
requirements  and  technical  standards  are 
met.  At  this  point,  copyright  approval  is 
sought  for  testing  materials  such  as 
literary  selections,  cartoons,  graphs, 
maps,  charts,  and  data  sets. 


Constructing  and 
Administering  Field 
Tests 

Examination  developers  at  the  Student 
Evaluation  Branch  construct  field  tests 
containing  questions  developed  by 
teacher  committees.  Each  field  test  is 
carefully  edited  and  revised  to  ensure 
technical  and  curricular  validity  and 
faithfulness  to  the  examination  blueprint. 
School  jurisdiction  personnel  grant 
permission  for  the  administration  of 
field  tests  to  students  in  their  systems  in 
January  and/or  June  of  each  school  year. 

Based  on  the  geographic  and 
demographic  variables  expected  for  the 
total  population  that  will  write  a given 
diploma  examination,  the  Student 
Evaluation  Branch  field  testing 
administration  staff  selects  a minimum 
sample  of  250  students  to  write  each 
field  test.  Field  tests  are  administered 
only  to  students  who  are  nearing 
completion  of  the  diploma  examination 
subject  being  tested  so  that  their 
performances  on  the  field  test  will  be 
predictive  of  the  performances  of 
students  writing  the  diploma 
examination. 

Student  Evaluation  Branch  professional 
staff  members  administer  the  field  tests 
under  secured  examination  conditions. 
This  procedure  allows  examination 
developers  to  receive  first-hand 
information  from  teachers  and  students 
about  examination  questions  and 
formats.  As  well,  the  procedure  ensures 
test  security  and  uniform  administration 
conditions  so  that  statistical  results  can 
be  considered  reliable. 

Teachers  whose  classes  participate  in 
field  testing  comment  on: 

• level  of  difficulty  of  questions 

• curricular  validity 

• appropriateness  of  questions,  data  sets, 
reading  selections,  format 

• problems  with  questions,  stimulus 
material,  art  work 

• clarity  of  instructions 

• correspondence  between  questions  and 
the  way  in  which  a concept  is  taught. 

Students  are  also  encouraged  to  discuss 
the  field  test  with  the  field  test 
administrator. 


All  of  the  data  from  field  testing — 
statistical  and  anecdotal — ^provide  the 
examination  developer  with  accurate 
and  first-hand  information  that  is  used 
to  ensure  that  the  final  form  of  each 
diploma  examination  is  a valid  and 
reliable  measure  of  students’ 
achievement. 

Analysing  and 
Revising  Questions 

Examination  developers  carefully 
analyse  the  statistical  results  and 
teacher  comments  for  each  field  test  to 
determine  the  need  for  additional  field 
testing.  Individual  questions  or 
question  sets  requiring  changes  are 
revised  and  submitted  for  further  field 
testing.  If  changes  are  not  feasible, 
questions  are  discarded. 

Questions  and  question  sets  that  prove 
successful  in  field  testing  are 
considered  for  inclusion  in  a diploma 
examination. 

Constructing  the 
Examinations 

The  diploma  examinations  are 
composed  of  questions  and/or 
question  sets  that  have  proven  to  be 
valid  in  field  testing.  For  each 
diploma  subject,  three  parallel 
examinations  are  developed  annually 
for  administration  in  January,  June, 
and  August.  The  three  examinations 
are  designed  to  be  parallel  in  form  and 
equivalent  in  difficulty.  Each 
examination  is  constructed  according 
to  the  approved  blueprint  (i.e.,  each 
will  have  approximately  the  same 
number  of  questions  testing  a 
particular  facet  of  the  curriculum  as 
specified  by  the  blueprint).  An 
information  bulletin  outlining  the 
design,  format,  and  marking  criteria 
for  each  diploma  examination  subject 
is  distributed  to  schools  at  the 
beginning  of  each  school  year.  The 
information  bulletins  include  changes 
from  previous  years’  examinations, 
sample  questions,  and  scoring  guides. 
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Approving  the 
Examinations 

Once  a final  form  of  a diploma 
examination  is  drafted,  it  receives 
extensive  editing,  proofreading,  and 
technical  checking.  The  examination 
developers  from  the  Student 
Evaluation  Branch  present  the  final 
form  of  each  examination  to  the 
Alberta  Education  committee  that 
represents  the  Curriculum  Standards 
Branch  or  Language  Services  Branch 
and  regional  offices  of  Alberta 
Education  for  review  and 
recommendations  for  improvement. 

The  recommendations  of  the  Alberta 
Education  committee  are  incorporated 
into  any  additional  revisions  that  are 
necessary.  The  examination 
developers  then  present  the 
examination  to  the  Examination 
Review  Committee  that  recommended 
approval  of  the  examination  blueprint 
in  the  second  phase  of  the  examination 
development  process.  The 
Examination  Review  Committee 
conducts  a final  review  of  the 
proposed  examination  and 
recommends  approval  to  the  Director 
of  the  Student  Evaluation  Branch. 

Printing  and 
Administering  the 
Examinations 

Following  the  Director’s  approval  of 
the  final  form  of  a diploma 
examination,  examination  developers 
ensure  completion  of  additional 
quality  checks  that  include  editing, 
proofreading,  validating  of  correct 
answers  by  a teacher  committee, 
checking  print  quality  of  art  work  and 
illustrations,  confirming  precise  match 
to  the  blueprint,  and  completing  a final 
estimate  of  difficulty  for  each 
question. 

Each  examination  is  printed  and  then 
distributed  to  schools  just  before  the 
administration  dates. 

Schools  are  responsible  for  ensuring 
the  security  of  examinations  before 
administration  and  for  ensuring  that 
examinations  are  administered 
according  to  regulations.  Each  school 
receives  extra  copies  of  the  January 


and  June  examinations  for  use  in  the 
school. 

Diploma  examinations  are  scheduled 
annually  in  January,  June,  and  August, 
and  are  conducted  according  to 
examination  regulations.  Schedules 
and  regulations  are  published  in  the 
General  Information  Bulletin  that  is 
distributed  to  schools  each  fall. 

The  August  examinations  are 
confidential  and  therefore  remain 
secured. 

Students  identified  as  having  learning 
and/or  physical  disabilities  may  apply 
for  special  provisions  for  examination 
writing.  Special  provisions  include 
brailled  examinations,  large-print 
examinations,  tape-recorded 
examinations,  additional  writing  time, 
use  of  a word  processor,  use  of  a tape 
recorder  for  responses,  and  use  of  a 
sign  language  translator.  The 
complete  policy  for  special  provisions 
is  printed  in  the  General  Information 
Bulletin  and  is  available  on  request 
from  the  Student  Evaluation  Branch 
(telephone  427-0010).  Following 
administration,  completed 
examinations  are  shipped  (in 
accordance  with  security  regulations) 
to  Alberta  Education  in  Edmonton  for 
processing  and  marking. 


Marking  the 
Examinations 

Markers  for  the  written-response  parts 
of  the  examinations  are  teachers 
nominated  by  their  superintendents 
and  are  selected  on  a proportional 
basis  so  that  the  percentage  of  markers 
selected  from  a geographic  area  is 
comparable  to  the  percentage  of 
papers  from  that  area.  To  be  selected 
for  marking,  a teacher  must  be 
currently  teaching  the  subject  he  or 
she  wishes  to  mark,  must  have  taught 
the  course  for  at  least  two  years,  and 
must  possess  a valid  Alberta 
Permanent  Professional  teaching 
certificate. 

Selected  classroom  teachers  are 
trained  in  the  marking  procedures  and 
are  supervised  during  the  marking 
session  by  the  professional  staff  from 
the  Student  Evaluation  Branch. 


The  written-response  parts  of  the 
diploma  examinations  are  all  marked 
centrally.  All  student  and  school 
identification  is  removed  from  the 
papers  before  the  marking  so  that 
markers  have  no  means  of  knowing  the 
source  of  a paper.  Written- 
response  papers  in  English  30, 

English  33,  Social  Studies  30,  and 
Fran^ais  30  receive  three  independent 
readings  and  are  scored  in  several 
categories  such  as  quality  of  language 
and  expression,  thought  and  detail, 
organization.  Students’  scores  are  then 
calculated  by  computer.  The  median 
score  on  each  dimension  is  the  score 
awarded.  Papers  receive  a fourth 
reading  on  dimensions  where  the 
original  three  markers’  scores  are  not 
sufficiently  congruent.  Multiple-choice 
responses  are  computer  scored.  During 
the  marking  session,  each  multiple- 
choice  examination  is  carefully 
reviewed  by  a group  of  at  least  20 
teachers  of  the  subject  under 
consideration.  In  this  “standard- 
confirming” review,  the  teachers  assess 
the  appropriateness  of  the  standard  of 
achievement  built  into  the 
examinations. 

Analysing  and 
Reporting  the  Results 

The  statistical  results  of  each 
examination  and  the  recommendations 
of  the  standard  confirmers  are  carefully 
analysed.  The  Examination  Review 
Committee  may  be  asked  to  review  the 
results  as  well.  Reports  of  local  results 
in  each  subject  are  prepared  for  all 
school  jurisdictions. 

Individual  student  results  are  mailed 
about  one  month  after  the  date  on 
which  the  examinations  were 
administered.  Students  who  are 
dissatisfied  with  their  results  in  any 
subject  may  request  that  their 
examination  in  that  subject  be  rescored. 
The  fee  for  rescoring,  including  GST, 
is  $21 .40  per  examination.  The  mark 
awarded  after  the  rescoring  supersedes 
the  initial  mark. 

For  more  information,  call  the  Assistant 
Director  of  Examination  Development 
for  Language  Arts  and  Social  Studies 
or  the  Assistant  Director  of 
Examination  Development  for 
Mathematics  and  Sciences 
at  427-0010. 
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Appendix  B 

Guidelines  for  Interpreting  and  Using 
the  Results  of  the  Diploma  Examinations 


Use  of  the  Reports 

In  addition  to  this  Diploma 
Examinations  Program  Annual 
Report,  superintendents  and  principals 
receive  a report  of  results  achieved  by 
the  students  in  their  jurisdictions  or 
schools.  If  requested  by  the 
superintendent,  similar  reports  for 
instructional  groups  within  the  school 
jurisdiction  are  also  provided. 

Educators  in  each  jurisdiction  are 
encouraged  to  study  the  examination 
results  carefully  and  use  them  to 
determine  the  strengths  and 
weaknesses  of  their  program  and 
resources. 

The  jurisdiction,  school,  and 
instructional  group  reports  may  be 
used  to  help: 

• evaluate  education  programs  in 
each  course 

• improve  the  quality  of  education 
programs 

• identify  the  strengths  and 
weaknesses  of  the  individual  student, 
school,  and  jurisdiction  by 
comparing  their  results  with 
provincial  results. 

Administrators  in  each  jurisdiction 
should  apply  separate  locally 
developed  teacher,  school,  and  school 
system  evaluation  policies  to  the  tasks 
of  evaluating  teacher  and  school 
performance.  These  reports  are  not 
intended  to  be  used  as  the  basis  for: 

• evaluating  teacher  performance,  or 

• comparing  performance  between  or 
among  schools. 

The  information  provided  in  the 
reports  is  factual  regarding  what  has 
happened.  The  interpretation  of  this 
information  involves  many  complex 
considerations  of  the  factors  and 
variables  that  contribute  to 
achievement. 


Factors  Limiting  the 
Interpreting  of 
Examination  Results 

Educators  who  are  interpreting  diploma 

examination  results  must  take  into 

account  the  following  limitations: 

1 . School-awarded  marks  and 
diploma  examination  marks  are 
complementary  measures.  The 
purpose  of  the  examination  is  to 
provide  a common  measure  of 
achievement  for  students 
throughout  the  province.  School- 
awarded  marks  should  reflect  all 
important  aspects  of  learning  in  a 
course,  including  those  that  cannot 
be  measured  by  time-hmited,  paper 
and  pencil  tests.  Therefore, 
differences  are  to  be  expected 
between  a student’s  school- 
awarded  mark  and  that  student’s 
diploma  examination  mark  in  a 
course.  Any  comparisons  of  the 
two  marks  should  be  restricted  to 
group  statistics  for  groups  of 
reasonable  size  and  should  be  made 
with  full  knowledge  of  the 
differences  between  the  two 
measures. 

2.  The  differences  between  provincial 
results  and  local  results  are  affected 
by  the  size  of  the  jurisdiction,  the 
school,  and  the  group. 

3.  Final  course  mark  distributions 
cannot  be  directly  compared  to 
school-awarded  mark  distributions 
or  to  diploma  examination  mark 
distributions. 

4.  Factors  affecting  student  selection 
of  diploma  examination  courses 
vary  from  school  to  school.  These 
factors  must  be  considered  when 
comparing  school  or  jurisdiction 
marks  with  provincial  marks: 

• Some  schools  may  have  a limited 
selection  of  courses.  Students 
with  weak  academic  records 
who,  in  other  schools,  would  have 


selected  nonexamination  courses 
will  find  it  necessary  to  take 
diploma  examination  courses  for 
credits. 

• Some  schools  may  have  a policy 
of  encouraging  students  to 
challenge  any  diploma 
examination  course,  which  results 
in  a higher-than-usual  proportion 
of  students  taking  those  courses. 

• Some  schools  may  have  a policy 
of  discouraging  students  with 
weak  academic  records  from 
enrolling  in  particular  diploma 
examination  courses,  which  results 
in  a lower-than-usual  proportion  of 
students  taking  those  courses. 

Factors  That  May 
Affect  Student 
Achievement 

Many  factors  or  variables  may 
contribute  to  student  achievement,  some 
of  which  are: 

1.  Environment 

• community  environment 

• school  environment 

• socioeconomic  background 

• family  circumstances 

2.  Student  Factors 

• ability 

• attitude 

• motivation 

• aspiration 

• academic  background 

• learning  style 

3.  Resources  (availability  and 
appropriateness) 

• programs  of  study 

• curriculum  guides 

• resource  materials 

• hbrary  services 

• current  textbooks 

• references 

4.  Instruction 

• qualifications  of  teachers 

• teacher  experience 
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• professional  development 

• teacher  morale 

• teaching  strategies 

• hours  of  instruction 

• staff  turnover 

• amount  of  homework  assigned 

• communication  of  teacher 
expectations. 

A Systematic  Approach 
for  the  Effective  Use  of 
Diploma  Examination 
Results 

Diploma  examination  results  can  be 
used  constructively  as  one  means  of 
improving  the  quality  of  education.  A 
systematic  use  of  these  results  would 
include  the  following  steps: 

1.  Comparing  test  results  for  a 
school  or  instructional  group  with 
the  provincial  results.  Be  sure 
that  your  comparisons  include  the: 

• total  test  score 

• total  multiple-choice  and 
written-response  scores 

• subscale  scores  for  multiple- 
choice  and  written-response 
questions  (this  current 
administration  as  well  as  results 
over  time) 

• individual  multiple-choice  and 
written-response  question  results. 

2.  Noting  any  patterns,  anomalies 
and/or  interrelationships  in  the 
results. 

3.  Hypothesizing  relationships 
between  your  observations  and 
any  of  the  factors  above  that  may 
have  had  an  effect  on  achievement. 

4.  Considering  and  implementing  a 
plan  that  will  help  improve  the 
quality  of  education  for  students. 

An  Administrative 
Model  for  the  Effective 
Use  of  Examination 
Results 

The  following  model  may  be  useful  for 
those  who  wish  to  develop  a 
constructive  system  for  interpreting 
diploma  examination  results.  This 


model  is  based  on  work  done  by 
Medicine  Hat  School  District  #76. 

Basic  Principles 

1.  It  is  desirable  and  feasible  to  ask 
teachers  and  school  administrators 
to  take  responsibility  for  analysing 
and  using  provincial  test  results. 

2.  The  development  of  analyses 

, statements  and  action  plans  by 
individual  schools  is  a more 
productive  and  positive  activity 
than  generalizations  made  by  an 
external  source. 

3.  There  are  identifiable  groups  of 
factors  which  affect  student 
achievement  that  should  be 
analysed  and  commented  upon 
when  reviewing  the  results  of 
each  test. 

4.  Subtest  results  are  often  more 
informative  than  are  total  test 
scores. 

5.  Generalizations  should  be  based 
upon  long-term  data. 

6.  It  is  not  necessarily  desirable  or 
productive  to  compare  the  marks 
of  schools  with  one  another. 

7.  Standardized  tests  measure  a core 
of  the  program  being  taught. 
However,  some  skills  and  concepts 
not  measured  are  worth  teaching 
and  learning. 

8.  Ensuring  that  there  is  an  ahgnment 
between  the  objectives  of  the 
curriculum  being  taught  and  the 
test  measures  being  used  will 
increase  the  level  of  students’ 
success. 

9.  Written  reports,  follow-up  by 
means  of  written  response,  and 
occasional  face-to-face  meetings 
are  useful  means  of  ensuring  that 
results  are  appropriately 
interpreted  and  used. 

Suggested  Content  for 
Interpreting  Individual 
School  Results 

1 .  Subject,  name,  grade  level,  and 
administration  date  of  the 
examination(s) 


2.  Number  of  students  who  wrote  the 
examination 

3.  Profile  of  students  who  wrote  the 
examination: 

• noteworthy  individual 
characteristics 

• general  or  group  characteristics 

• previous  performance  in  other 
years 

4.  Retention  rates:  the  number  of 
students  enrolled  in  the  grade  or 
subject  in  the  previous  two  years 

5.  School  performance  as  compared 
with  district  and  provincial  averages 

6.  Present  school  performance  as 
compared  with  previous  years 

7.  Subtest  results:  a discussion  of  how 
students  performed  on  each  of  the 
subtests,  possible  reasons  for 
results,  and  recommended  action 

8.  Item  analysis:  those  items  where  a 
significant  number  of  students  chose 
a response  other  than  the  correct 
answer;  i.e.,  do  the  resources  being 
used  appropriately  present  the 
material  being  tested? 

9.  Program  emphasis: 

• hours  of  instruction 

• skills  and  content  emphasized  or 
de-emphasized 

10.  Instructional  practice: 

• methodology 

• curriculum  fit 

• resources 

11.  Program  objectives  that  are  not 
measured  by  paper-and-pencil  tests 
but  that  are  worth  teaching 

12.  Recommendations  for  next  year:  a 
list  that  describes  actions  that  should 
continue  to  occur,  should  be 
enhanced,  or  should  be  changed 

13.  Summary  report:  general  concluding 
comments  regarding  the  analysis, 
report,  examination,  and 
recommendations 

14.  Name  and  signature  of  teacher  or 
department  head  and  principal. 


48 


Suggested  Procedures  for  Reporting 

1.  Teachers,  department  heads  and/ 
or  principals  analyse  and  prepare  a 
written  report  about  each 
administration  of  a diploma 
examination. 

2.  Principals  review  and  sign  the 
report. 

3.  The  report  is  shared  with  central 
office  supervisory  personnel. 

4.  The  appropriate  central  office 
supervisory  personnel  prepare  a 
written  response  to  the  report  and 
send  copies  of  the  response  to  the 
teacher,  department  head,  and 
principal. 


5.  If  possible,  all  involved  staff  meet 
to  discuss  the  report  and  the 
response. 

6.  When  necessary  or  desirable,  a 
more  immediate  analysis  of 
specific  subtest  scores  may  be 
requested  for  a specific  class, 
grade,  school,  or  examination. 

7.  A sampling  of  the  reports  will  be 
shared  with  the  Education/ 
Personnel  Committee  of  the  board. 

8.  All  reports  will  be  used  as  an 
additional  means  of  recognizing 
the  quality  of  instruction  being 
delivered  to  students.  The 
analysis  will  be  used  to  improve 
the  program  being  offered  and 


maximize  the  opportunities  for 
students  to  be  successful. 

9.  Where  results  are  significantly 
different  from  those  expected  by 
school  staff,  consider  arranging  for 
a program  evaluation  that  would 
measure  such  things  as  the  variance 
between  the  program  being  offered 
and  the  specifications  for  an 
individual  examination. 

10.  The  report  for  the  January  and 
June  administrations  will  include 
comprehensive  retention  rates  for 
three  years  of  the  program. 
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Appendix  C 

Percentage  Distribution  of  Marks  in 
Diploma  Examination  Courses 


January  1994* 


Diploma 

Examination 

Course 

School- 

Awarded 

Mark 

Diploma 

Examination 

Mark 

Final 

Course  Mark 

January  1993 
Final 

Course  Mark 

ENGLISH  30 

A^=  10  613 

= 10  657 

A (80-100%) 

16.4 

9.9 

11,0 

10.9 

B (65-79%) 

41.9 

37.2 

42,2 

42.4 

C (50-64%) 

34.6 

41.1 

41,9 

42.3 

F (0-49%) 

7.1 

11.8 

4,9 

4.4 

Mean 

66.5 

63.6 

65,6 

65.6 

Standard  Deviation 

12.4 

12.1 

11,0 

10.8 

ENGLISH  33 

A^=  4 900 

N=  4 621 

A (80-100%) 
B (65-79%) 
C (50-64%) 
F(0-49%) 


6.0 

33.6 

47.1 

13.3 


6.1 

40.2 

39.7 

14.0 


38,3 

49,8 

7,6 


4.1 

39.4 

50.7 

5.8 


Mean 

Standard  Deviation 


60.9 

11.7 


62.5 

11.9 


62,4 

10,1 


62.8 

9.6 


FRANGAIS  30^ 

- 

14 

A^=  55 

A (80-100%)  n/a  n/a 

n/a 

14.6 

B (65-79%) 
C (50-64%) 
F (0-49%) 


n/a 

n/a 

n/a 


n/a 

n/a 

n/a 


n/a 

n/a 

n/a 


72.7 

12.7 
0.0 


Mean 

Standard  Deviation 


nidi 

nidi 


n/a 

n/a 


n/a 

n/a 


71.7 

8.3 


SOCIAL  STUDIES  30 

N=  8925  /V=  8 735 

A (80-100%)  18.4  11.7 

13,2 

13.1 

B (65-79%)  39.5  32.3 

37,3 

35.8 

C (50-64%)  36.5  37.2 

42,2 

42.6 

F(0-49%)  5.6  18.8 

7,3 

8.5 

Mean  67.2  62.3 

65,1 

64.6 

Standard  Deviation  12.1  13.8 

12,1 

12.4 

* The  figures  may  change  slightly  as  a result  of  appeals  of  school-awarded  marks,  rereads  of  diploma  examinations,  or  special 
cases  considerations. 

t The  January  1994  results  for  Frangais  30  are  not  reported  because  only  14  students  received  final  course  marks. 
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(continued) 


Percentage  Distribution  of  Marks  in  Diploma  Examination  Courses 


Diploma 

Examination 

Course 

January  1994* 

January  1993 
Final 

Course  Mark 

School- 

Awarded 

Mark 

Diploma 

Examination 

Mark 

Final 

Course  Mark 

MATHEMATICS  30 

N=  10  585 

N=10  609 

A (80-100%) 

24.4 

15.3 

19.2 

B (65-79%) 

34.9 

27.7 

33.5 

33.5 

C (50-64%) 

32.5 

31.9 

37.2 

37.5 

F (0-49%) 

8.2 

25.1 

11.5 

9.8 

Mean 

68.1 

61.3 

65.1 

66.1 

Standard  Deviation 

14.0 

16.0 

14.2 

14.5 

BIOLOGY  30 

iV  = 8539 

= 9 919 

A (80-100%) 

21.5 

23.7 

22.5 

19.7 

B (65-79%) 

36.2 

32.1 

34.6 

34.1 

C (50-64%) 

33.9 

27.1 

33.5 

35.8 

F (0-49%) 

8.4 

17.1 

9.4 

10.4 

Mean 

67.2 

66.1 

66.1 

Standard  Deviation 

13.4 

16.3 

14.2 

14.0 

CHEMISTRY  30 

A^  = 7097 

N=  8 082 

A (80-100%) 

24.1 

20.3 

21.5 

B (65-79%) 

36.9 

27.5 

33.8 

38.0 

C (50-64%) 

31.1 

30.2 

33.9 

31.8 

F (0-49%) 

7.9 

22.0 

11.2 

8.7 

Mean 

68.2 

63.4 

66.3 

67.5 

Standard  Deviation 

13.7 

16.9 

14.6 

13.9 

PHYSICS  30 

iV=  3 086 

N=  3 333 

A (80-100%) 

31.0 

30.1 

26.3 

B (65-79%) 

39.3 

32.9 

38.4 

36.0 

C (50-64%) 

24.8 

23.6 

26.0 

28.8 

F (0-49%) 

4.9 

13.4 

6.0 

8.9 

Mean 

71.2 

69.0 

70.6 

68.8 

Standard  Deviation 

13.2 

15.8 

13.7 

14.8 

* The  figures  may  change  slightly  as  a result  of  appeals  of  school-awarded  marks,  rereads  of  diploma  examinations,  or  special 
cases  considerations. 
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Diploma  Examination  Courses 
Final  Course  Marks 

January  1994  and  January  1993 


Percentage  of  Students  Achieving  Acceptable  Standard 
(Final  Course  Marks  of  50%  to  100% 


95.1  95.6  94_2 


100 


1994  1993 


English  30  English  33  Fran9ais  30  Social  Studies  30  Mathematics  30  Biology  30  Chemistry  30  Physics  30 


Percentage  of  Students  Achieving  Standard  of  Excellence 
(Final  Course  Marks  of  80%  to  100%) 


100-1 


80- 


60-1 
Percentage 

40-1 


1994  1993 


29.5 


English  30  English  33  Fran9ais30  Social  Studies  30  Mathematics  30  Biology  30  Chemistry  30  Physics  30 
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Percentage  Distribution  of  Marks  in  Diploma  Examination  Courses 

June  1994* 


Diploma 

Examination 

Course 

School- 

Awarded 

Mark 

Diploma 

Examination 

Mark 

Final 

Course  Mark 

January  1993 
Final 

Course  Mark 

ENGLISH  30 

N=14  526 

N=14  473 

A (80-100%) 

18.2 

10.2 

11.5 

10.4 

B (65-79%) 

41.6 

32.8 

39.5 

39.4 

C (50-64%) 

32.6 

41.6 

43.2 

44.7 

F (0-49%) 

7.6 

15.4 

5.8 

5.5 

Mean  (%) 

66.9 

62.5 

65.2 

64.9 

Standard  Deviation  (%) 

12.7 

12.8 

11.4 

11.2 

ENGLISH  33 

iV=  6161 

N=  5375 

A (80-100%) 

5.9 

4.1 

2.8 

2.5 

B (65-79%) 

31.1 

34.3 

33.1 

33.1 

C (50-64%) 

48.9 

43.7 

55.2 

55.5 

F (0-49%) 

14.1 

17.9 

8.9 

8.9 

Mean  (%) 

60.3 

60.4 

60.9 

60.8 

Standard  Deviation  (%) 

11.8 

11.6 

9.8 

9.8 

FRAN^AIS  30 

Ill 

II 

4^ 

A (80-100%) 

33.3 

10.7 

16.0 

4.5 

B (65-79%) 

40.0 

43.9 

50.6 

59.1 

C (50-64%) 

18.7 

34.7 

30.7 

34.1 

F (0-49%) 

8.0 

10.7 

2.7 

2.3 

Mean  (%) 

71.7 

64.7 

68.5 

66.2 

Standard  Deviation  (%) 

13.5 

12.9 

11.6 

9.0 

SOCIAL  STUDIES  30 

N=  12  325 

N=  12  735 

A (80-100%) 

21.7 

15.6 

16.8 

14.8 

B (65-79%) 

38.5 

33.6 

37,7 

35.2 

C (50-64%) 

33.9 

34.3 

38.7 

41.0 

F (0-49%) 

5.9 

16.5 

6.8 

9.0 

Mean  (%) 

67.9 

64.0 

66.3 

65.0 

Standard  Deviation  (%) 

12.7 

14.2 

12.6 

12.9 

* The  figures  may  change  slightly  as  a result  of  appeals  of  school-awarded  marks,  rereads  of  diploma  examinations,  or 
special  cases  considerations.. 
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(continued) 


Percentage  Distribution  of  Marks  in  Diploma  Examination  Courses 


June  1994 


Diploma  School-  Diploma 

Examination  Awarded  Examination 

Course  Mark  Mark 

January  1993 
Final  Final 

Course  Mark  Course  Mark 

MATHEMATICS  30 

A^=  10 

533  = 10  676 

A (80-100%)  23.7  15.3 

B (65-79%)  33.3  24.4 

C (50-64%)  32.9  30.1 

F(0-49%)  10.1  30.2 

17.1 

30.2 

38.2 

16.5 

28.1 

37.3 

14.5 

18.1 

Mean(%)  67.3  59.8 

63.9 

62.7 

Standard  Deviation  (%)  14.6  17.4 

15.1 

15.5 

BIOLOGY  30 

iV  = 9 513  A^=  12  050 

A (80-100%)  24.3  21.7 

22.2 

22.2 

B (65-79%)  35.8  27.7 

31*9 

32.4 

C (50-64%)  31.6  28.1 

34.0 

34.2 

F (0-49%)  8.3  22.5 

11  o 

11.2 

Mean(%)  68.0  63.7 

66.2 

66.4 

Standard  Deviation  (%)  14.0  17.2 

1 /f  o 

1 yl  ^7 

14*9 

14.  / 

CHEMISTRY  30 

A^  = 7701  A^=9  166 

A (80-100%)  26.9  23.3 

23.9 

20.7 

B (65-79%)  35.7  26.8 

32.9 

34.9 

C (50-64%)  28.8  27.7 

/ 

F (0-49%)  8.6  22.2 

12.5 

11.9 

Mean(%)  68.8  64.0 

66.8 

66.3 

Standard  Deviation  (%)  14.4  18.1 

15.5 

14.8 

PHYSICS  30 

4 499  iV=  5 182 

A (80-100%)  35.7  32.1 

B (65-79%)  36.2  25.8 

32.1 

33.2 

26.0 

34.6 

C (50-64%)  23.4  23.8 

26.5 

OQ  O 

Zy.y 

F (0-49%)  4.7  18.3 

8.2 

9.5 

Mean(%)  72.3  67.7 

70.4 

68.4 

Standard  Deviation  (%)  13.7  18.6 

1 C 'I 

A A Q 

1 H-.O 

* The  figures  may  change  slightly  as  a result  of  appeals  of  school-awarded  marks,  rereads  of  diploma  examinations,  or  special 
cases  considerations. . 
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Diploma  Examination  Courses 

Final  Course  Marks 

June  1994  and  June  1993 


Percentage  of  Students  Achieving  Acceptable  Standard 
(Final  Course  Marks  of  50%  to  100%) 


1994  1993 


English  30  English  33  Fran^ais  30  Social  Studies  30  Mathematics  30  Biology  30  Chemistry  30  Physics  30 


Percentage  of  Students  Achieving  Standard  of  Excellence 
(Final  Course  Marks  of  80%  to  100%) 

100-1 


1994  1993 
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Diploma  Examinations  Program 

Annual  Report  Questionnaire 

The  Student  Evaluation  Branch  strives 

content  and  format  of  the  report  are 

Jim  Brackenbury 

to  produce  documents  that  will  be 

reviewed  before  the  production  of  the 

Assistant  Director,  Analytical  Services 

useful  to  educators.  The  purpose  of 

next  issue. 

Student  Evaluation  Branch 

this  questionnaire  is  to  collect  your 

Alberta  Education 

opinions  about  the  Annual  Report.  All 

Please  take  a moment  to  respond  to 

11160  Jasper  Avenue 

opinions  will  be  considered  when  the 

the  questions  and  send  to: 

Edmonton,  Alberta  T5K  0L2 
FAX:  422-4200 

Your  Use  of  the  1993-94  Annual  Report 


1.  Check  the  boxes  that  apply  to  you. 
Currently.  1 am  pnmanl>  a 

• teacher  □ 

• school  administrator  □ 

• central  office  administrator  □ 

• school  board  member  n 

• other  (please  specify) 


2.  I read  the  report,  but  I DID  NOT  use  it  to  interpret  my  students’  results.  □ 


3.  I read  the  report,  and  I used  it  to  interpret  students’  results  in 

• my  classroom  • my  school  • my  jurisdiction 


□ 


□ 


□ 


4.  If  you  checked  one  of  the  three  boxes  in  question  3,  please  respond  to  this  question. 
I used  the  results  to  alter  the  education  program  in 

• my  classroom  • my  school  • my  jurisdiction 

□ □ □ 


Continued 


Content  of  the  Report 


1.  Please  check  the  appropriate  box  to  indicate  your  assessment  of  each  section  of  this  report. 

Very  Adequately  Somewhat  Not 

Useful  Useful  Useful  Useful 


Section  2:  Summary  of  Results 


Section  3:  Results  by  Gender  | | I I I I [ 


Section  4:  Results  for  Population  Subgroups 


Section  5:  Special  Study:  Participation  Rates  over  Time 


Section  6 : Achievement-Over-Time  Studies  | | 


Section  7:  Examiners’  Annual  Summary  Statements 


Format  of  the  Report 


1.  Please  check  the  appropriate  box  to  indicate  your  assessment  of  the  report’s  format. 

Very  Adequately  Somewhat  Not 

Useful  Useful  Useful  Useful 

Organization  into  Separate  Sections 

□Z] 

□ □ [ZZ 

Triple-Column  Presentation  of  Text 

[ZZ 

Ez:  □ zzi 

Presentation  of  Figures 

□ 

zz  □ □ 

Presentation  of  Tables 

□ 

zz  ZZI  zz 

Blending  of  Information  in  Text,  Figures,  and  Tables 

n zz  zz 

2.  Further  comments  on  this  report  are  most  welcome.  Please  use  the  space  below  for  that  purpose,  or  write  to  the  Assistant 
Director,  Analytic  Services,  Student  Evaluation  Branch. 
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